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UNITED  STATES  DEPARTMENT  OF  EDUCATION 

Of  F  ICfc  Or  THI  ASSISTANT  SFCRETARY 
FOR  FDUCATIONAl  RFSF ARCH  AND  IMPROVEMFNT 


INTRODUCTION  TO 
REGIONAL  EDUCATIONAL  LABORATORIES  COMPETITION  MATERIALS 

Dear  Colleague: 

The  Office  of  Educational  Research  and  Improvement  (OERI),  of 
the  U.S.  Department  of  Education,  is  planning  a  new  competition 
for  awards  to  operate  ten  regional  educational  laboratories. 
The  laboratories  have  been  supported  by  the  Federal  government 
since  1966.  The  solicitation  for  proposals  will  be  issued  in 
January  1990?  the  awards  will  be  announced  in  October  1990,  and 
the  new  contracts  will  begin  on  December  1,  1990. 

The  purpose  of  these  documents  is  to  provide  in-depth 
information  about  the  laboratory  system  to  potential  applicants 
and  others  interested  in  this  competition. 

Two  invitational  meetings  and  three  open  meetings  were  held  in 
June  and  July,  1989  to  give  interested  parties  an  opportunity  to 
irake  suggestions  to  the  Department  concerning  various  aspects  of 
the  functions,  activities  and  future  directions  of  the 
laboratories.     In  addition,  OERI  commissioned  seven  policy 
papers  on  various  aspects  of  the  laboratory  program  and 
laboratory  functions. 

Following  is  a  list  of  documents  concerning  these  and  other  OERI 
activities  related  to  the  competition.     The  number  of  pages  for 
each  document  is  shown  in  parentheses: 

Descriptions  of  the  current  regional  educational  laboratories 
and  a  map  of  laboratory  regions.  (36) 

Federal  Register  Notice,  dated  June  23,  1989,  announcing 
invitational  meetings  and  open  meetings.  (2) 

Transcripts  of  invitational  meetings,  June  26  and  27,  1989, 
Washington,  D.C.     (83,  96) 

Summary  Report  of  invitational  meetings  by  Anne  H.  App. 

Transcripts  of  the  open  meetings: 

July  19,  1989,  Kansas  City,  Missouri  (30) 

July  19,  1989,  Washington,  D.C.  (60) 

July  21,  1969,  San  Francisco,  California  (30) 

"Report  of  the  Laboratory  Review  Panel  on  t^e  1987  Review  of 
Laboratories",  October  6,  1987.  (19) 

"Report  of  the  Laboratory  Review  Panel  on  the  Pending  Laboratory 
Recompetition" ,  April  28,  1989.  (21) 


ERiC 


WASHINGTON,  D.C.  20208— 


Commissioned  Policy  Papers  (1989) 


"Regional  Educational  Laboratories:     The  Strategy  of  Usable 
Ignorance11;    William  Dunn  (35) 

"Classroom  and  School  Research:     Investments  in  Enhancing 
Schools";    Thomas  Good  (94) 

"Regional  Educational  Laboratories:  History  and  Prospect11  James 
Guthrie  (25) 

"Policy  Paper  on  the  Program  of  Regional  Educational 
Laboratories:    The  Perspectives  of  a  Chief  State  School 
Officer";  David  Hornbeck  (35) 

"The  Future  of  Regional  Educational  Laboratories  in  Contributing 
to  Urban  School  Improvement";    Ploretta  Dukes  McKenzie  (12) 

"School  and  Classroom  Improvement  in  Two  European  Countries" ; 
Neville  Postlethwaite  (18) 

"A  Comparison  of  Service  Modes  in  the  Department  of  Education's 
Technical  Assistance  Programs";    Brenda  Turnbull  (24) 

Commissioned  Research  Paper: 

"Regional  Educational  Laboratory  Approaches  to  Educational 
Improvement:    A  Descriptive  Synthesis11;  Ward  Mason,  December 
1988.  (212) 

We  hope  these  materials  trill  be  of  value  and  assistance  to 
educators  in  general  and  to  those  who  are  interested  in  the 
competition  for  regional  educational  laboratories. 


Sincerely, 


David  P.  Mack,  Director 
Educational  Networks  Division 
Office  of  Educational 
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URC 

UNIVERSITY 
RESEARCH 
CORPORATION 


October  5,  1987 


Dr.  Chester  E.  Finn,  Jr. 
Assistant  Secretary  and 

Counselor  to  the  Secretary 
U.S.  Department  of  Education 
400  Maryland  Avenue,  S.W. 
Washington,  DC.  20202 

Dear  Checker: 


The  report  of  the  Laboratory  Review  Panel  on  the  review  of  Regional  EducaMonaJ 
Labs  is  forwarded  to  you. 

The  Panel  is  pleased  to  have  had  the  opportunity  to  comment  on  the  review  As 
noted  in  the  report,  we  believe  the  review  was  conducted  verv  competentls  and 
that  the  results  will  be  beneficial  to  the  labs  and  to  OER1. 

We  have  focused,  for  the  most  part,  on  program-wide  issues  in  our  report.  We  have 
utilized  the  opportunity  to  draw  upon  all  of  the  reports  on  individual  labs  to  help 
identify  issues  for  your  consideration. 

You  will  see,  however,  that  we  have  some  specific  recommendations  and 
observations  rr  tardmg  three  individual  labs.  In  our  judgement,  these  matters 
warrant  specia  attention.  We  hope  you  will  consider  these  recommendations,  as 
well  as  the  others,  and  ad\ise  us  at  an  appropriate  time  of  any  actions  taken  with 
respect  to  these  matters. 

I  would  be  pleased  to  speak  with  you  to  discuss  this  report,  as  would 
Joy  Frechtlmg  and  Garry  McDaniels,  other  Panel  members  who  are  in  this  area 

The  Panel  plans  to  meet  three  times  per  year  hereafter  on  a  regular  basis.  Our 
agenda  from  here  forward  will  concentrate  on  monitoring  !he  icsults  of  the  revieu, 
discussion  of  forthcoming  evaluation  activities,  and  providing  input  to  polic\ 
regarding  the  future  of  the  program. 

If  you  have  suggestions  about  how  the  Panel  may  be  of  further  assistance  to  vou 
please  let  me  know. 

Sincerely^  / 

Christopher^.  Cross 
Chairman 

Laboratory  Review  Panel 
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REPORT  OF  THE  LABORATORY  REVIEW  PANEL 
ON  THE  1987  EXTERNAL  REVIEW  OF  LABORATORIES 


I.  Observations  About  the  Review  Process  - 

In  the  summer  of  1987,  OERI  conducted  an  external  peer  review  of  the 
nine  regional  tducatlonal  labs.  The  purpose  of  the  review  was  to 
tvaluate  lab  performance  during  the  first  18-20  months  of  their 
contracts  and  also  to  tvaluate  their  plans  for  the  remaining  three  years 
of  the  contracts. 

A  team  of  external  reviewers,  accompanied  by  the  cognizant  OERI 
Institutional  liaison  (IL),  visited  each  lab  for  two  and  one-half  days. 
The  teams  had  been  trained  In  Washington  for  two  days  prior  to  the 
on-site  visits.  The  teams  read  the  labs'  3-5  year  plans  and  othe- 
documents  necessary  for  their  work.  Standardized  evaluation  criteria  had 
been  developed  for  review  of  both  lab  performance  and  plans. 

While  on-site,  the  teams  met  with  lab  board  members,  management  and 
staff.  The  teams  also  contacted  selected  lab  clients  and  constituents  by 
telephone  to  determine  their  perceptions  of  the  labs'  performance.  The 
review  was  conducted  within  relatively  short  timelines  and  with 
relatively  llclted  resources. 

The  panel  has  compiled  Information  about  the  review  from  several 
sources:  (a)  reports  from  review. teams  and  OERI  Institutional  liaisons 
(IL  s);  (b)  meetings  with  the  review  team  leaders,  IL's  and  lab 
executive  directors;  (c)  written  comments  from  the  executive  director* 
concerning  their  reviews;  (d)  visits  to  a  lab  by  most  panel  members 
while  a  site  visit  was  lti  progress;  and  (e)  review  of  lab  3-5  yea-  plans 
and  needs  assessments.  In  addition,  the  panel  chair  briefly  observed  the 
review  teams    training  and  spoke  to  the  reviewers. 

Before  proceeding  with  detailed  comments  on  the  review,  the  panel  has 
some    preliminary  observations  to  make  about  its  overall  nature  and 
findings.  The  OERI  design  generated  much  factual  information  about 
specific  aspects  of  lab  performance  and  plans.  Reviewers  absorbed  a 
great  deal  of  written  and  oral  information  about  the  labs  and  their 
reports  are  very  factual. 

The  review  generated  relatively  little  Information  about  external 
considerations  In  the  labs'  environments.  For  example,  while  information 
Is  available  about  constituents'  and  cliants'  perceptions  of  the  labs, 
there  is  not  documented  evidence  about  labs'  effects  In  the  regions.  Nor 
did  the  review  address  such  a  question  as:  "Is  this  the  optimal 
arrangement  of  service  improvement  organizations  in  the  regions?"  OERI 
•taff  did  not  sac  the  review  as  capable  of  addressing  such  broader 
Issues.  It  plans  to  address  such  issues  in  other  parts  of  its  lsb 
evaluation  plan.  The  panel  concurs  with  the  OERI  position  in  this 
regard. 


Detailed  comments  on  the  review  process  follow. 
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The  review  was  exceptionally  wpTI  organized  and  Implemented.  Ir 
particular:   "  r  —  - — - 

-The  reviewers  were  broadly  representative  of  lab  constituent  groups 
They  were  selected  as  a  rosult  of  a  wide  search  process  which  Included 
requests  for  nominations  from  a  larger  number  of  professional 
organisations  and  other  sources.  The  reviewers  therefore  brought  a  fr*s* 
view  to  the  evaluation  of  labs.  The  panel  regards  this  outreach 
positively. 

-  OERI  spent  considerable  time  and  effort  in  preparing  and  training  the 
reviewers.  These  preparations  apparently  provided  teams  with  a  common 
understanding  of  the  purposes  and  criteria  for  the  review.  Room  for 
appropriate  discretion  wt-,  nonetheless  left  for  review  teams  regarding 
the  details  of  individual  reviews.  Reviewers  were  motivated  and 
industrious  while  on-site. 

-  The  reviewers  were  sensitive  to  the  issues  faced  in  the  labs.  Their 
backgrounds  provided  ther  with  relevant  perspectives  with  which  to  do 
their  job. 

-  Communication  from  OERI  to  the  labs  about  the  review  was  good. 
Information  about  procedures,  criteria  and  schedules  was  communicated  to 
the  labs  in  advance.  This  apparently  facilitated  understanding  and 
acceptance  of  the  review  by  the  labs. 

-  The  labs  were  very  open  to  the  review  process.  They  responded  to 
questions  and  provided  information  freely  and,  in  general,  treated  the 
review  as  a  learning  opportunity. 

-  The  OERI  institutional  liaisons  (IL's)  plaved  a  kev  role  in  the 
review.  They  provided  historical  and  Departmental  perspectives  about  the 
labs  which  would  othervise  not  have  been  available  to  the  panel.  Thev 
also  provided  an  additional  source  of  information  on  numerous  key 
issues.  This  information  helped  the  panel  "triangulate"  data  sources  and 
perspectives  in  its  work. 

Vlth  hindsight,  some  things  might  be  done  differently.  We  recommend  the 
following  changes  i-i  any  future  reviews: 

-  Reviewers  be  given  exemplars  of  critical  characteristics  of  "good 
labs    against  which  to  make  comparisons. 

-  Each  teas  should  revisw  more  than  one  lab.  The  teams  in  this  review 
did  not  have  such  cross-cutting  assignments  or  membership.  This 
prevented  reviewers  from  having  .ore  than  one  basis  for  making  Judgments 
about  lab  performance  and  plans.  In  general,  the  panel  believes  there  is 
a  tendency  for  reviews  of  this  type  to  produce  positive  results 
Institutions  being  reviewed  find  it  helpful  to  have  a  person  to'talk 
with,  explain  one's  programs,  etc.  This  does  not  mean  the  results  from 
this  review  are  to  be  disbelieved,  but  the  tendency  for  positive 
findings  to  result  from  such  a  process  should  be  kept  in  mind. 
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-  The  pane!  received  rc'-tively  little  information  about  the  qualit-  or 
impact  of  lab  products.  The  panel  recommends  further  information  about 
this  topic  be  developed  in  the  future.  If  not  done  through  such  a 
review,  it  should  be  done  through  other  means. 

-  Consideration  should  be  given  to  paying  reviewers.  In  this  case,  the 
teams  did  a  tremendous  amount  of  work,  even  going  beyond  the  number  of 
days  they  nominally  agreed  to  serve.  However,  some  of  them  had 
reservations  about  non-payment  and  it  is  unlikely  that  many  of  them 
would  volunteer  to  perform  the  same  service  on  an  unpaid  basis  again. 
This  would  impair  OERI's  ability  to  obtain  consistency  in  review  teacs 
over  time.  (Further,  non-payment  would  have  been  a  severe  barrier  in 
this  case  to  any  attempt  by  OERI  to  have  teams  review  more  than  one 
lab.) 

Taking  into  account  all  the  observations  and  caveats  above,  the  panel 
considers  this  review  exemplary  and  credible  in  light  of  the  time  and 
resources  available.   


II.  Observations  About  the  3-5  Year  Plans 

The  panel  wishes  to  frame  its  observations  about  lab  plans  drawn  from 
this  review  on  a  program-wide  basis.  It  believes  that  such  a  perspective 
car.  best  complement  the  laboratory-specific  orientation  of  the  external 
review  teams. 

The  panel  does  not  believe  it  has  sufficient  information  to  qualify 
review  team's  findings  about  individual  laboratories'  performance.  It 
believes  more  information  about  lab  impact  from  the  field  U  desirable. 
The  panel  will  say.  however,  that  it  has  no  evidence  of  gross 
discrepancies  between  labs'  stated  commitments  and  performance  to  date. 

This  section  will  therefore  comment  on  program-wide  Issues  and 
consideration?  which  have  been  raised  through  the  panel's  discussions  of 
and  participation  in  the  review.  The  panel  believes  these  are  generallv 
unresolved  matters  and  varrant  the  Assistant  Secretary's  attention. 

The  panel  thinks  regards  the  present  level  of  effort  being  expended  bv 
OERI  and  the  developing  nature  of  its  relationships  with  the  labs 
postively.  The  panel  is  not  under  any  illusions  that  the  relationships 
are  trouble-free.  But  it  believes  (particularly  Its  members  who  are 
knowledgeable  about  prior  administrative  arrangements  within  NIE/OERI) 
that  the  assignment  of  individual  OERI  staff  for  major  parts  of  their 
time  as  institutional  liaisons,  together  with  focused  OERI  management 
attention  to  the  program,  is  praiseworthy. 

Incorporation  in  the  program  of  the  indirect  services  strategy  (working 
with  and  through  intermediaries)  is  a  significant  development  in  the 
labs    history.  The  strategy  has  affected  the  kind  of  work  the  labs 
conduct.  Jt  also  has  implications  for  the  appropriate  way  to  evaluate 
labs   work.  The  panel  does  not  believe  the  full  implications  of  this 
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fe"dtebele"  UnderSt°°d  "  M°"  counts  en  this  toplc  are 

Unresolved  Issues  and  Considerations 

T!>e.  3"5L!e,r  Pl'nS  develnP'H  Kv  leave  Questions  for  the  Pane] 

about  the  overall  clarity  and  ggg  of  the  UbT  minion-— 6T^Z. 

I  7*fr  pllnS  lnd  «CC0»P«nying  needs  assessments  were  about  400 
pages  per  institution.  This  often  made  It  difficult  for  the  panel  to  get 
a  clear  picture  of  what  a  lab  It  doing.  Stylistically,  executive 

EZE  J!  SLlJ*  Pl"S  "l8ht  h'lp-  ^••""iv.ly.  the  entire  plans  could 
•imply  be  written  more  succinctly. 

In  particular,  the  panel  frequently  found  it  hard  to  get  a  clear  idea  cf 
what  overall  sense  of  motion  drove  the  lab  plans.  For  example,  whether 
a  lab  .ought  to  better  enable  its  constituencies  to  handle  change  on 
their  own,  to  "gap  fill"  with  needed  services,  or  to  act  as  a 

XlH?1!!"0*  ?f  fnfornatlon  wlthin  *««  r«gion  (or  some  combination  of 
these)  was  not  always  clear.  Ironically,  the  extensive  amount  of 
verbiage  in  the  plans  did  not  help  with  this  problem. 

ISfff8!^1  Jell^es  one  by-product  of  such  lack  of  clarity  is  that  it  is 
difficult  to. set  reasonable  expectations  for  lab  performance.  As  a 

llTll\l?<  °bservatlon'  the  P*n«l  believes  the  labs'  .elf  assessments  mav 
!n/!i*v.rJy  8trong?r  ln  "••■•i»8  specific  activity-level  performance' 
and  weaker  in  assessing  program-wide  or  institutional  performance, 
especially  impact. 

in  Z  lJiS  5"  r?  1°  ttS,  Per«Ptlon  °f  of  clarity  and  Vision 

in  the  labs    missions  and  their  role  in  the  school  improvement  process. 

lAl  tlVTA     <  ?"  ,oaetl,nes  "biguous  internal  guidelines  in  use  by 
when  rllJlll?    ^  t0  °ffer  °r  "fuSe  "rvi"s  t0  constituents 

TiliZ       !  ?  I  ?"  "  8t°P  Mrvic"  once  started.  Lack  of  a  larger 

vision  of  .  laboratory's  mission  may  in  part  lead  to  uncertainty  in  this 
area  of  programmatic  decision-making. 

The  viyln  which  labs  get  priorities  la  not  «i„.r  clear-  The  panel 

5hat  «««»iv«  needs  assessments  hsve  been  done  to'help  guide  the 
Itr  <  V?"  ?Jana-         ltVtl  0f  ,ffort  «xP«nd«d  «d  «ount.  of^data 

£l«£L£J "J:/"1  ara,hl8h-  BUt  th*  P*nel  f"1-ntly^id  not  see  the 
relationship,  between  needs  assessment  data  and  the  choice  of  programs 
or  strategies  made  by  the  labs.  programs 

coBJa«;r^fdJKfflrity/n  ,8tabllahin8  ™*  ■•l.tion.hip.  lay  with  the 
complexity  of  the  labs  decussation,  discussed  above.  In  part,  the 

XeTJ        ffplleatad  of  the  need.  a.£...nt  data 

themselves.  The  data  would  in  many  cases  support  numerous  strategies  and 

Juch8^:;.'0:: ln  fact*  than  ?h: iab  eouid  *v«r  b°pa  <°     S?  " 


ERIC 


10 


5 


ERIC 


Stated  differently,  the  panel  believes  there  may  be  patterns  of  service 
allocation  to  different  populations  and  areas  of  their  regions  made  by 
the  labs  which  can  not  be  predicted  by  the  needs  assessment  data  and 
which  may  not  reflect  any  other  stated  premises.  The  panel  recoanends 
more  succinct  information  be  presented  in  the  future  regarding  reasons 
for  adoption  of  lab  strategies  and  allocation  of  services. 

In  s  similar  vein,  some  plans  contain  commendable  ststements  of  regional 
context  considerstions,  in  part,  we  understsnd,  in  response  to  OESI 
requests.  But  It  is  not  always  clear  that  the  actual  choice  of  programs 
underteken  by  s  lab  has  any  direct  relationship  to  the  context 
considerstions  described.  One  lab,  for  example,  noted  the  severe 
economic  considerations  in  its  region,  but  its  programs  did  not  deal 
directly  with  finance  Issues,  or  how  schools  In  its  region  might  deal 
with  budgetary  crises.  Greater  synergy  between  contextual  considerations 
outlined  in  the  plans  and  the  plans  themselves  Is  desirable. 

The  implications  of  the  indirect  service  ("with  and  through")  strategies 

need  further  examination-  The  Pan#i  v<fom„.iv  ....fw  in?  «-n  about 

how  Indirect  service  strategies  are  working  In  the  labs.  These 
strategies  are  clearly  a  major  aspect  of  the  labs'  programming.  The 
pa.ie]  believes  the  labs  have  established  networks  where  they  did  not 
exist  before  as  a  result  of  the  strategies.  It  also  believes  the  labs 
serve  clients  through  existing  networks  as  well.  But  the  Impact  of 
indirect  service  strategies  Is  felt  not  only  with  respect  to  work 
performed  specifically  under  Task  Two  of  the  contracts  (where  the 
provision  ir  contained),  but  also  with  regard  to  how  a  lab  perceives  o* 
itself  as  ?    institution.  In  the  latter  regard,  some  labs  have 
experienced  a  profound  shift  of  identity  and  purpose  from  being  a 
developer  and  provider  of  R&D  to  that  of  a  linking  agency,  working 
primarily  with  and  through  other  educational  service  agencies. 

The  following  specific  aspects  of  the  indirect  service  strategies  are 
highlighted  for  consideration. 

-  There  needs  to  be  a  better  understanding  of  the  range  of  partners  with 
wnoir,  labs  might  work  and  which  choices  are  most  efficacious. 

-  Indirect  service  strategies  have  different  implications  in  different 
|  type  regions  (e.g..  for  the  Far  Vest  Lab's,  where  there  are  many 

intermediaries  and  the  Appalachla  Lab's,  where  there  are  relatively 

-  The  lab  RFP  states  acceptable  conditions  under  which  labs  may  work 
directly  at  the  local  level.  In  general,  these  guidelines  appear  to  have 
been  followed.  In  most  cases,  for  example,  labs  do  not  appear  to  define 
building  level  personnel  as  s  primary  type  of  client.  There  are 
individual  cases,  however,  where  a  lab  is  working  directly  at  the  local 
level  In  which  it  1.  not  clear  that  It  has  «  mandate  to  do  so.  Some 
clarification  of  these  guidelines  as  they  relate  to  the  3-5  year  plans 
may  be  desirable.  3 

-  The  strategies  may  subject  labs  to  uncontrollable  influences.  For 
9              example,  the  Governor  of  California  recently  cancelled  a  program  of 


11 


technical  assistance  centers  with  which  the  Far  West  Laboratory  was 
working  as  part  of  its  indirect  services*  This  development  has  required 
reprograttaing  by  the  lab. 

-  The  1985  recompetition  resulted  in  a  transition  of  labs  from 
institutions  which  conducted  tome  significant  R&D  on  their  own,  to  ones 
providing  assistance  aervir.es,  primarily  in  partnerships  with  others. 
While  ths  change  has  clear  benefits,  one  cost  is  the  loss  of 
practitioner-oriented  R&D  that  labs  used  to  conduct.  In  part,  this 
transition  makes  the  choice  of  the  R&D  that  labs  incorporate  in  their 
services  more  critical.  Based  on  knowledge  presently  available  to  it, 
the  panel  is  not  sure  that  there  is  a  sufficient  locus  of 
practitioner-oriented  research  emanating  from  other  sources  which  the 
labs  may  draw  upon. 

•    As  indicated  earlier,  the  panel  believes  more  information  about  lab 
Impact  is  desirable.  But  while  the  ultimate  goal  of  labs  is  school  and 
classroom  improvement,  it  isn't  clear  that  looking  for  such  outcomes  is 
the  appropriate  criterion  for  a  lab  using  indirect  service  strategies, 
except  in  given  situations  where  there  is  a  discernible  linkage  between 
services  delivered  by  the  lab  and  the  ultimate  school  beneficiaries. 
Such  situations  are  probably  the  exception  rather  than  the  rule.  Further 
attention  to  this  issue  is  warranted. 

Are  the  labs  to  be  pro-active  or  reactive  within  their  regions?  The 
panel  perceives  an  issue  which  appears  to  be  unresolved  regarding  the 
labs'  role  in  their  regions:  the  degree  to  which  they  are  to  be 
pro-active  in  identifying  areas  for  involvement  and  taking  leadership  in 
those  areas,  and  the  degree  to  which  they  should  be 
"const  ituent-dri ven" . 

T*  is  issue  reflects  facets  of  the  other  Issues  which  have  preceded  it  in 
this  section  of  the  report,  i.e.,  whether  the  labs  have  an  overall 
vision  of  their  mission,  whether  their  needs  assessments  are  adequate 
and  their  programs  related  to  them,  and  the  implications  of  the  indirect 
service  strategics  for  the  institutions.  But  new  considerations  are 
raised  as  well. 

On  the  one  hand,  when  a  lab  has  a  clear  sense  of  constituent  needs  and 
follows  them,  it  will  presumably  play  a  useful  role  in  its  region.  But 
its  programs  may  be  changing  and  unrecognizable  from  one  year  to  the 
next.  On  the  other  hand,  If  a  lab  stakes  out  leadership  in  an  area,  it 
risks  both  political  backlash  and  changing  priorities  which  may  render 
its  capabilities  and  agenda  obsolete. 

In  this  regard,  the  panel  notes  that  some  labs  have  identified  areas  in 
which  they  are  particularly  strong.  That  is  good;  however,  a  team  in  one 
case  has  reported  that  the  lab  had  a  tendency  to  diagnose  or  Interpret 
clir^t  problems  in  terms  of  a  school  improvement  area  in  which  it  had 
particular  expertise  and  then  frame  its  services  in  that  area. 

As  indicated,  the  pro-active/reactive  issue  is  but  one  aspect  of  others 
raised  here,  perhaps  most  strongly,  that  of  what  is  the  larger  vision 
labs  have  of  their  mission.  The  pane]  believes  the  labr  must  strike  a 

12 


-  7  - 


balance  between  being  pro-active  and  rtactive.  It  Is  not  sure  such  a 
balance  is  understood  or  has  been  achieved  among  the  labs. 

To  what  degree  should  regional  labs  also  have  some  national  identity? 
The  panel  has  inquirtd  abovt  the  extent  to  which  labs  perceive 
themselves  as  being  oriented  entir.ly  to  their  regions,  or  whether  they 
have,  or  should  have,  some  national  identity  or  outlook  as  well. 

The  panel's  perception  is  that  the  labs  are  very  strongly  oriented  to 
their  regions.  This  is  a  strength.  On  the  other  hand,  there  are  some 
leg  .imate  roles  outside  the  region  which  labs  might  become  involved 
with. 

Appropriate  national  visibility  and  orientation  can  be  achieved  through 
national  recruitment  and  staffing  of  labs'  key  positions.  Participation 
in  appropriate  national  professional  activities  is  also  appropriate. 
Laboratories  do  these  things.  One  important  national  role  might  be  tc 
exert  leadership  in  one  or  more  areas  of  school  improvement.  This  might 
be  done  through  original  collaborative  arrangements  with  parties 
outside,        •  '1  us  within,  the  labs'  regions.  Collaboration  will  be 
discussed  oelc 

One  aspect  of  the  labs'  role  whi'ch  the  panel  finds  troubling  is  sr 
apparent  lack  of  concerted  effort  by  either  CERl  or  the  institutions  to 
develop  a  general  plan  for  fostering  collaboration  with  other  R&D 
resources  funded  by  the  Department  of  Education.  The  panel  has 
identified  numerous  assistance  activities  funded  by  the  Department,  with 
whom  the  labs  might  collaborate.  These  are  shown  cn  Table  1  (following 
page),. 

The  panel  hslieves  more  collaboration  can  be  achievad  between  labs  and 
other  Departtaentally-funded  resources  and  strongly  urges  that 
appropriate  action  be  taken  to  bring  about  such  collaboration. 

Collaboration  among  labs  -    The  panel  questions  whether  the  intended 
degree  ar.d  benefits  of  collaboration  among  the  labs  are  being  achieved. 
The  1985  RFP  stipulated  that  labs  should  "work  in  collaboration  with 
centers  and  vith  ether  labs  on  regional  and  national  educational 
problems".  Laboratories  are  to  allocate  ten  percent  of  their  budgets  to 
collaboration  under  Task  Five  to  participate  in  activities  that  "addresp 
more  than  one  region  or  are  nationwide  in  scope".  Specific  Task  Five 
activities  may  Include: 

a)     exchange  of  information  on  R&D  needs  and  practices  through 
meetings,  newslettei    or  electronic  networks; 

development  of  resources  for  improvement,  e.g.,  .yntheses.  training 
nodules,  workshop  designs; 


b) 

c) 
d) 
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engagement  in  collaborative  improvement  efforts  across  regions; 

assisting  OERI  in  understanding  needs  of  educational  practitioners 
in  regions  and  nationwide; 
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Table  1 

OTHER  ASSISTANCE  RESOURCES  FUNDED 
BY  THE  U.S.  DEPARTMENT  OF  EDUCATION 
WITH  WHOM  REGIONAL  LABORATORIES  MIGHT  COLLABORATE 


Office/Activitv 


binding 

($  In  millions) 


Educational  Research  and  Improvement  (OERI) 

Educational  Research  Centers  (18)  17.8 
ERIC  Clearinghouses  (16) 
National  Diffusion  Network  (NDN) 

State  Facilitators  (53)  4>8 

Leadership  in  Educational  Administration 

Development  (LEAD)  Program    Centers  (51)  7.1 


Elementary  and  Secondary  Education  (OESE) 

Chapter  I  Technical  Assistance  Centers  (4)  3.6 

Indian  Education-  Regional  Resource 

Centers  (5)  2.2 

Drug  Free  Schools  Centers  (5)  g.g 

Special  Education  and  Rehabilitative  Services 

(OSERS) 

Regional  Resource  Centers  (5)  2.2 

Bilingual  Education  and  Minority  Language  Affairs 

(OBEMLA) 

Mul.ti-Functional  Resource  Centers  (16)  jq.o 

Evaluation  Assistance  Centers  (2)  q.7 

Bilingual  Education  Clearinghouse  j>0 
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Table  1  (continued) 


OTHER  ASSISTANCE  RESOURCES  FUNDED 
BY  THE  U.S.  DEPARTMENT  OF  EDUCATION 
WITH  WHOM  REGIONAL  LABORATORIES  MIGHT  COLLABORATE 


Civil  Rights  (OCR) 

Desegregation  Assistance  Centers  (10)  8.2 

Vocational  and  Adult  Education  (OVAE) 

National  Center  for  Research  on  Vocational 

Education  (NCRVE)  6.0 

Community  Coordination  Centers  (6)  0.8 

Total  Funding  78#0 


The  regional  offices  of  the  Department  (Secretary's  Regional 
Representatives)  are  also  resources  with  whom  the  labs  might  work. 
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e)      cooperating  In  work  In  national  research,  development. 

dissemination  and  improvement  problems  jointly  identified  by  the 
lab  and  0ER1. 

A  central  coordinating  group  was  described  in  the  RFP  that  would  be 
convened  by  OERI  in  consultation  with  the  labs.  It  would  determine 
guideline*,  procedural  and  priorities  and  would  involve  assignments  to 
cross-laboratory  task  forces  for  planning  and  implamentation.  An  annual 
meeting  of  lab  governing  board  chairs,  executive  directors  and  OERI  was 
also  envisioned. 

Nine  "theme  areas"  emerged  from  lab  plans  in  FY  *36.  Three  of  these  were 
administrative  in  nature,  including  electronic  networking  and 
evaluation.  The  electronic  networking  has  occurred  as  envisioned  and 
some  effective  collaboration  on  substantive  themes,  e.g.,  higher  order 
thinking  skills,  the  urban  education  network,  state  policy  and  rural 
education.  Collaboration  in  other  areas,  however,  has  lagged  and  except 
for  two  of  the  above  areas,  content-based  products  have  not  been 
developed  as  yet. 

OERI  staff  have  reported  several  difficulties  with  Task  Five 
implementation  to  date.  One  concerns  laboratory  leadership  foi  specific 
themes.  There  *s  a  lack  of  balance  and  consistency  among  labs  in  taking 
leadership  for  themes.  Some  labs  have  taken  the  lead  in  more  than  one 
area  and  at  least  one  has  not  taken  the  lead  in  any.  Lead  labs  cannot 
force  other  labs  to  cooperate  and  lead  lab  leadership  is  very  fragile; 
it  sometimes  does  not  emerge  and  is  usually  highly  person-dependent. 

It  has  been  difficult  tc  identify  the  overall  dimensions  of  Task  Five 
because  the  work  in  the  labs  often  overlaps  that  in  other  tasks. 

OERI  staff  have  made  the  following  recommendations  regardirg  the 
implementation  of  Task  Five: 

1)  The  notion  of  the  "lead  lab"  should  be  re-evaluated  in 
cooperation  with  the  labs.  The  number  of  "lead"  areas  per 
lab  may  need  to  be  limited. 

2)  A  more  equitable  distribution  of  work  among  labs  be 
determined  In  collaboration  with  them. 

3)  OERI  should  take  a  more  active  and  collaborative  role  in 
implemtnting  Task  Five  activities,  ideally  by  having  each  member 
of  the  OERI  Laboratory  team  serve  as  a  liason/f acilitator  for  a 
theme  area. 

4)  The  institutional  liaiaons  would  have  responsibility  for  generating 
collaborative  efforts  across  OERI  and  the  Department. 

5)  Products  devtloptd  undtr  Task  Five  should  be  disseminated 
nationally  through  a  variety  of  educational  agencies. 

6)  Meetings  among  OERI  staff  and  lab  staff  should  continue  as 


q  necessary  to  reach  these  objectives. 
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The  panel  endorses  the  general  intent  of  these  recommendations.  It 
suggests  that,  in  addition,  further  thought  be  given  to  the  incentives, 
or  lack  thereof,  for  labs  to  participate  in  Task  Five  as  presently 
implemented.  The  panel  also  believes  that  the  responsibility  for  success 
of  Task  Five  is  shared  by  OERI  and  the  labs.  While  the  labs  need  to  live 
up  to  the  spirit  of  the  contract  requirements,  OERI  will  need  to  take 
strong  central  leadership  if  the  potential  in  this  area  is  to  be 
realized. 

Public  and  private  education-    With  one  exception,  the  team  reports  did 
not  highlight  the  degree  of  services  being  provided  to  private 
education.  The  panel  does  not  have  enough  information  in  this  area  of 
the  program  to  comment  knowledgeably . 

The  panel  believes  that  service  to  private  schools  Is  of  greater 
significance  in  some  regions  than  others  and  that  the  interests  of 
individual  labs  in  it  should  be  guided  by  their  regional  characteristics 
and  governing  boards.  (Private  school  officials  are  among  various  types 
of  educators  the  1985  RFP  recommended  for  consideration  in  board 
membership.)  The  panel  also  believes  the  labs  should  be  sensitive  to  the 
needs  of  intermediary  organizations  (i.e.,  through  indirect  service 
strategies)  serving  private  education.  Among  these  these  organizations 
are  those  serving  specific  populations,  such  as  the  Association  of 
Tribal -Controlled  Schools. 

Regulation  of  the  Labs-  The  panel  is  interested  in  the  efficiency  and 
productivity  of  the  organizational  and  contractual  relationships  between 
the  labs  and  OERI.  Among  the  topics  in  which  it  is  specifically 
Interested  are  the  following: 

-  The  degree  of  specificity  in  the  lab  contracts.  The  panel  believes 
that  the  specificity  of  contracts  emphasizes  process  at  the  expense  of 
(1)  a  concept  of  overall  \ab  role  (2)  substantive  emphasis  (3)  vislor  of 
successful  service  and  (A)  indicators  of  success. 

-  The  panel  believes  the  degree  of  reporting  required  by  OERI  mav  be 
excessive.  But  given  that,  it  is  still  possible,  as  suggested  in* the 
discussion  of  clarity  and  vision  of  the  labs*  mission,  the  labs  writs 
too  ouch  in  response  to  the  OERI  requirements.  A  greater  balance  in 
reporting  requirements  between  the  need  for  detailed  accountability  and 

4  programmatic  clarity  needs  to  be  sought. 

-  The  panel  believes  there  is  en  inherent  conflict  between  the  greater 
degree  of  control  end  specificity  appropriately  demanded  in  contracts 
and  the  autonomy  lodged  in  the  concept  o;f  regional  labs.  The  panel  is 
aware  of  the  previous  discussions  about  tut*  subject.  It  relieves  that 
the  potential  for  use  of  cooperative  agreements  in  the  fut;  re  in  the 
program  is  worthy  of  investigation.  But  for  the  moment,  the  panel  would 
have  to  conclude  that  the  ideal  procurement  mechanism  for  use  in  the 
program  does  not  exist. 
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Re^-    r.shlp  Betvec-r  OERI  and  non-OERI  activities-  The  panel  is  aware 
that  labs  differ  greatly  In  the  extent  to  which  they  hive  non-OERI 
funding.  The  Implications  of  this  deserve  attention.  These  include: 

-  Laboratories  difier  greatly  in  their  entrepreneurial  behavior  as 
regards  non-OERI  fx  nding.  Some  of  the  more  nature  ones  have  sizable 
proportions  and  amounts  of  such  funding.  On  the  one  hand,  this  reflects 
organizational  health  and  vitality.  The  panel  is  concerned,  however, 
that  such  labs  may  be  shifting  valued  staff  and  other  resources  as 

n«!8!ir?  1°  conPet«  for  «nd  conduct  such  services  at  the  expense  of  the 

OEKi-runded  work. 

-  The  panel  Is  concerned  that  OERI  may,  unintentionally,  be  subsidizing 
lab*  :o  compete  with  other  organizations  for  other  OER:  and  non-OERI 
work.  Labs  may  be  afforded  an  advantage  in  competitions  because  of  their 
relatively  bettzr-developed  institutional  capacity  and  accumulated 
abililty  to  tap  other  resources.  The  panel  recognizes  that  the  OERI 
contracts  do  not  have  that  purpose  and  it  is  not  OERI's  intent  to  afford 
labs  unfair  advantage  when  competing  for  funds.  Some  means  to  ensure 
that  this  is  not  the  case,  however,  or  other  resolution  of  this  matter, 
may  nonetheless  be  appropriate. 

-  The  panel  is  aware  that  newer  labs  without  other  sources  of  funding  or 
cash  reserves  face  unique  needs  regarding  their  cash  flow.  The  panel 
believes  that  OERI  should  be  responsive  to  such  needs. 

Organizational  maturity-  An  issue  somewhat  related  to  that  of  OERI  and 
non-OERI  activities  is  that  of  organizational  maturity.  The  labs  vary 
widely  on  this  dimension.  The  older  ones  have  been  in  existence  for  soce 
twenty  years,  the  newer  ones  for  two  to  three  years.  The  following 
considerations,  therefore,  are  worthy  of  attention  regarding  the  labs* 
varying  organizational  maturity. 

-  The  panel  believes  the  older  labs  might  productively  assist  the 
younger  ones  on  a  selective  basis  in  either  governance,  organization  and 
managment,  or  programmatic  areas.  OERI  staff  have  cited  examples  of  how 
such  intra-lat  assistance  has  occurred.  This  is  praiseworthy.  The  panel 
believes,  however,  that  such  assistance  might  be  extended.  Older  labs 
might  particularly  take  the  lead  in  collaboration  under  Task  Five. 

I.?!!'!?  lli.1;b8*.bS  Perh/P?  th*  0lder  00,8  in  Particular,  there  is  a 
?!  t     k££        *       1°.  t?1  Vtth  n?W  Md  unf0"i°g  tduc.tional  areas 
<:l'lu    **JI  order,thinkln8  ■kills),  or  ratrain  existing  staff  to  deal 
!"*        P;"*1/;60^1"8  th«  n««d  *>*  stability  in  personnel 
administration  of  a  lab  and  for  some  continuity  in  staffing    On  the 
other  hand,  stability  and  continuity  will  not  always  meet  challenges  in 

!IlMI"i!'  "V"!1        hMrd  •  conc«™  «».t  l«bs  may  b«  entering  into 
fields  where  they  do  not  have  adequate  staff  expertise,  nor  plans  to 
acquire  that  expertise.  The  panel  recommends  that  the  labs'  capacity  to 

S        f  '!!  mVl  ?i!n8!S  r,<Iulr,d  10  thair  mission  and  clients' 
llnt<A<    ,xaained-  Spscific  factors  to  be  examined  include  policies  for 
UTAH**  !  r,?uir,d«        Priding  staff  development  for 

I     ??    d«v«loP»«n<  can  and  should  be  a  vital  part  of  each 
laboratory's  overall  personnel  program. 
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Still    </  matteTS-        P«el  d«Part  here  from  its  focur  on 

lis       v to* conaent  °n  * few  Mtter6  "uted  to  iu-ividtt.i 

Jn  !:J  t  "ferred  to  are  the  newer  ones.  These  comments  are  made 

ILI  IL    J?;"  wth6y  "late  t0  the  8peclflc  labs  *nd  ln  P«t  because 
they  exemplify  the  .orts  of  i.aues  which  may  face'  new  inititution^ 
generally.  They  are  thus  relevant  to  the  1990  r.competition. 

ilnvr!nr%K°  J*1*  ?0r.th  Central  Re«l0°«l  Educational  Laboratory  reflect 
many  strengths  in  the  institution.  They  al.o  reflect  struggles  the  ul 

JleilS^..TK  1°  *ChleV•  *«lud.  marginally  adequate 

lltillilit  J?      w?  0OW  b!lng  renovated) .  turnover  in 

management  and  cash  flow  problems  related  to  Departmental  payment 
procedures.  (The  lab  did.  however,  have  flnancill  reserves  av.ij.ble  to 
til*-**  Prtde««sor  organization  which  prevented  dire  consequences 
from  occurring  due  to  the  cash  flow  problems). 

The  present  executive  director  of  the  lab  asserts  that  the  turnover  in 
management  has  not  adversely  affected  it.  Whatever  the  case  in  that 

llVtlrv  ?!  that  f°r  *  °ewer  ln"itution  with  such  a 

11    yl,~      8h0Uld  contlnue  t0  oonitor  the  situation  carefully.  Two 
rather  different  monitoring  postures  are  appropriate.  One  is  to 
encourage  and  support  appropropriate  growth  of  the  lab.  The  other. 

rZ'7.l'<       t0  C°UnSel  ooderation  ln  "pirations.  if  necessary,  so  that 
the  lab  s  progrannatic  reach  does  not  exceed  its  organizational  and 
managerial  grasp. 

The  Southe?  t  Educational  Improvement  Laboratory  has  had  cash  flow 

Lr;  !;:'t::;s: were  UTgels du? to  its  nev  "«tus  •*  •  ^  without  .nv 

ImllMlr  I  S    t  {&A  blCk  Up0n'  Dif"culties  in  attaining  a  ' 

satisfactory  payment  mechanism  experienced  with  the  Department's 
contracts  and  finance  offices  have  exacerbated  the  laboratory's  cash 

tl?t  IZll^lJX      8  ltS  inltU1  Perl0d'  11,6  PMel  18  PlM"d  to  note 
!«LSL  iTSir  'PP"r  re80luti0n-  »•  P«"l  encourages  close 

attention  by  OEM  management  to  any  similar  situations  in  the  future. 

The  Regional  Laboratory  for  the  Northeast  and  Islands  grew  out  of  a 
pre-existing  organization  and  is  implementing  a  novel  structure  for 
providing  service.  State  assistance  centers  have  been  established 
through  existing  organizations  on  a  decentralized  basis  as  a  means  to 

liriH  ;  •ub,t"tlaJ  por"on  °f  <h«  Moratory',  a.rvic".  Tnt  pane" 
has  heard  arguments  for  and  against  the  .fficacy  of  this  strategy*  It 
has  two  observations  te  make  in  this  regard.  »"ategy.  it 

SSrtw* SSSll^^^L^  Ub  U  ^^""ing  a  ,tr.t.gy  which 
was  clearly  included  in  its  winning  proposal  in  J985.  Any  uncertainty, 
or  even  unease,  with  the  novel  characteristic,  of  this  .tr.t^  ought 
not.  therefore  to  be  turned  into  premature  Judgment.  abo«  itfs^ess 
The  second  observation  is  that,  notwithstanding^  con?"ctwl 
validity,  .nough  exp.rl.nce  ha.  b..n  gained  with  the  «       2  te  warrant 
.  .p.ci.1  activity  to  .xplor.  it.  progress  .nd  prospect"  ?E  „ 
therefore  r.commends  th.t  the  lab  be  requested  to  jLtly  convene  such 
«n  activity  with  OEM  during  th.  flr.t  .ix  months  of  th.new  wozrla 
y«r.  Th.  .ctivity  would  .x.»in.  the  oper.tion  of  th.  ArT.gl "f  St.. 
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reactions  to  it  from  the  field  and  possible  future  directions  for  it 
Representatives  of  various  lab  constituents  and  clients,  plus  others' 
with  the  potential  to  contribute  to  the  discussion,  would  be  invited  tc 
participate.  The  panel  would  follow  the  course  of  this  activity  closelv 


III.  Recommendations  Reeling  the  Future  of  the  Program 

The  panel  has  a  responsibility  to  make  recommendations  covering  the 

irUine  5rI1hthe  J*  PT°|r-'  "  "U  "  ,»edl"e  considerations 
f^Xf/lT     ?  •xtffnal  r«vl«w-  A  focal  point  for  these  longer  ten 
i!S!2  ?  I  J    \ilS°liCi"  r,levant  t0  th«  "competition  of  the  ill? 
scheduled  for  1990  and  administration  of  the  program  thereafter. 

The  panel  makes  the  following  recommendations  at  this  time.  They  are 
stimulated  by  discussion  of  this  review.  They  .re  not,  however? 

»    ?.£    Li  t    ^"^  P?r,peCtlV"  t0  the  tasV  of  »ch°01  improvement 
end  labs.  The  recommendations  below  in  part  reflect  those  perspectives. 

Make  the  programsatlc  realities  and  the  contractual  recim-™.!.*, 
cotppatibi  e*  ■ 

The  panel  recognizes  the  need  for  OERI.  or  any  funding  agency,  to  be 
accountable  for  administration  of  its  contracts.  On  the  other  hand,  lab* 
are  "gaged  in  work  which,  by  definition,  is  client-driven  to  a 
considerable  degree  and  thus  changing  in  nature.  The  present  contract 
IT*  1"ment*  «PP"r  1°  i»P°"  an  unrealistic,  degree  of  precision  upon 
labs  ir.  stating  in  advance  what  they  plen  to  do.  at  least  for 
outyears  ,  or  these  beyond  the  current  and  next  ones. 

hiV!!!!J  5,^;"""^  thM  iSSUe  "™er  ln  thls  "P°rt-  K  recommends 
JtlJt  r    ?  I        StUdy  °i  deslrabl«  Procurement  procedure,  for  new 

»e«.J?M  ?f  "  *"  inte8ral  "P8Ct  of  Plan^n8  tor  the 

recompetition  Itself. 

Strengthen  Departmental  program  adminlstration- 

frL^^SL?"  !°Ufht  !°  ISS?-  the  °r«r"io«  of  the  Department's 
I  «nd  C0"™"  Service  (CCS)  in  .upport  of  the  l.bs.  It  has  no 

E*!!  #  ?,     J*?*  'J*'  D«P«rtB«nt«1  Procurement  regulations  .re  not 
oMwiJr;        ^V*  co""cts-  »°n.th.l...,  it  b.s  b..rd  reports 
lab  rJJI",     resolving  cash  flow  problem,  and  .low  .pprov.l  of  otuer 

i!!c!!Jh<  PIMl  h"  co"n8,1,d  •"tnticm  by  l.b.  to  b..lc  utter,  of 
ISJJST         "MniMtlon.  the  panel  eoun.el.  OERI  to  take  whatever 
•ction  Is  possible  to  .trength.n  the  contr.ct  administration  of  this 
Ef-!*.?.?^0!  t0  •Miin8  •dd4tlon«1  "affing  in  the  relevant  GCS 

JtSS     !  *  0n!  addltlona3  Bt«P'  lt  *»  to  hav.  in.titution.l 
iClJ!  5    ;       ]  ,,ln  Mxlmua  «dv.ntage  of  the  power,  which  are  lodged  in 
their  de.ign.tion  as  the  "Contracting  Officer'.  Technical 

delegate  con.id.r.bly  more  di.cr.tion  to  their  program  officers 
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having  that  designation  than  does  GCS.  .he  panel  strongly  believes  that 
appropriate  training  of  ILfs  in  their  COTR  role  is  desirable. 

The  panel  also  notes  that  IL's  are  overburdened  with  administrative 
details.  Such  details  art  inappropriate  for  their  role  as  senior  staff 
and  also  hinder  their  addressing  larger  programmatic  issues.  Designation 
of  junior  staff  to  apprentice  two  or  thrtt  ILfs  is  desirable. 
Apprentices  could  both  assist  ILfs  with  thsir  administrative  work  and 
prepare  to  assume  IL  responsibilties  when  staff  vacancies  occur.  Such 
staffing  would  also  ensure  that  there  would  be  adequate  back-up 
knowledge  about  a  lab  and  its  region  in  the  absence  of  the  IL. 

Further  examine  the  fiscal  requirements  of  establishing  and  operating  a 
lab- 

The  panel  has  been  struck  by  the  vastly  different  degree  of  overall 
financial  resources  available  to  individual  labs,  par:icularly  some 
comparisons  between  older  ones  and  newer  ones.  Attention  should  be  given 
to  ways  that  labs'  cash  flow  needs  may  be  met.  On  the  one  hand,  labs 
should  not  be  required  to  endure  financial  hardship.  On  the  other  hand, 
they  should  not  o\er-aggreslvely  seek  other  sources  of  funds,  possibly 
at  the  expense  of  OERI-funded  activities*  or  the  labs'  own  sense  of 
self-identity.  The  panel  strongly  recommends  that  consideration  be  given 
to  including  fees  in  any  future  contracts.  Such  fees  are  a  reasonable 
way  to  develop  reserves  to  meet  unexpected  needs  and  are  in  fact 
consistent  with  the  contractual  relationship  between  the  department  and 
the  labs. 

Exaclne  the  "entrepreneurial"  behavior  of  the  labs- 

The  panel  believes  the  behavior  of  labs  with  large  amounts  of  non-OERI 
funding  Is  in  fact  a  significant  determinant  of  their  overall 
institutional  behavior.  The  panel  recognizes  that  OERI  is  only 
Accountable  for  conduct  of  work  It  funds,  but  it  is  not  possible  in 
every  instance  to  understand  performance  of  OERI-funded  work  without 
understanding  the  broader  environment. 

The  panel  recommends  that  this  "entrepreneurial"  aspect  of  labs, 
specifically  hov  it  affects  OERI-funded  work,  be  studied  prior  to  the 
reconpetltlon.  Such  a  study  would  address  patterns  of  seeking  non- 
OERI-funded  work  by  labs,  the  amounts  and  types  conducted  and  the 
distribution  of  available  resources  within  a  lab  between  OERI-funded  and 
non-OERI-funded  work. 


Clarify  the  paperwork  in  the  program- 

The  combined  requirements  for  paperwork  imposed  on  the  labs  by  the 
Department's  contracts  office  and  OERI  are  very  large.  Still,  some  labs 
seem  to  have  gone  beyond  the  bounds  of  what  even  OERI  required  in  their 
submission  of  documents  for  this  review. 


For  the  recompetltlon,  documentation  must  be  submitted  In  sufficient 
detail  to  allow  a  valid  and  reliable  review  process  to  be  conducted.  For 
program  administration,  adequate  documentation  also  needs  to  be 
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submitted.  But  as  Indicated  earlier,  the  panel  believes  the  amount  of 
documentation  submitted  In  connection  with  this  review  may  have  actually 
obscured  some  larger  vision  of  what  the  labs  are  doing.  Clearer,  more 
tucclnct  documentation  Is  possible  In  this  program  and  should  be 
encouraged. 

Study  the  Implications  of  the  Indirect  services  ("vlth  and  through") 
strategy- 

The  panel  Is  impressed  vlth  the  degree  to  which  the  labs  have  sought  to 
Implement  this  strategy*  It  has  had  major  effects  on  the  character  and 
programs  of  many  of  the  Institutions* 

Still,  there  are  many  unanswered  questions  about  the  best  way  to 
implement  this  strategy  and  Its  Implications*  Among  these  questions  are 
the  most  appropriate  groups  with  whom  to  work  "with  and  through",  the 
effects  of  not  serving  some  groups,  the  degree,  If  any,  to  which  this 
strategy  should  be  Imbued  in  all  the  labs*  work  and  appropriate  ways  to 
evaluate  labsf  performance  working  In  this  mode. 

A  forthcoming  field  study  appears  to  offer  one  opportunity  to  examine  at 
least  some  of  these  issues.  The  strategy  and  Its  implications  should  be 
studied  thoroughly  prior  to  commencing  the  recunpetltlon. 

Re-examine  the  assumptions  underlying  needs  assessments 

The  panel  Is  not  convinced  the  extensive  needs  assessments  are 
adequately  serving  their  Intended  purpose  of  guiding  programmatic 
planning  vlthln  the  regions.  On  the  one  hand,  there  is  too  much  data.  Or. 
the  other  hand,  the  data  do  not  always  adequately  track  planning 
decisions  and  the  allocation  of  services  actually  made*  The  panel 
recommends  that  the  possibility  of  shorter  needs  assessments  be 
explored,  also  that  greater  visibility  be  given  to  labs'  unpublished 
bases  for  making  decisions* 

More  coordination  Is  needed* 

The  panel  commends  OERI  and  the  labs  for  the  efforts  taken  to  coordinate 
activities  among  labs*  But  much  more  can  and  should  be  done*  Within 
OERI,  better  coordination  of  the  ILfs  activities  can  be  accomplished. 
Better  coordination  of  the  lab  program  vita  other  OERI«fundf*d  activities 
is  particularly  desirable* 

The  labs  can  improve  coordination  among  themselves  and  vlth  other 
parties*  As  Indicated  earlier  in  this  report,  the  panel  does  not  believe 
that  the  labs  are  benefiting  from  such  coordination  of  their  activities 
to  the  extent  they  and  their  clients  might* 

Further  study  of  this  Issue  is  desirable*  It  should  Include  analysis  of 
the  successes  and  failures  of  the  present  coordination  provision  in  the 
contracts  (Task  Five),  but  not  be  bound  by  the  present  contractual 
provisions*  OERI  should  specifically  study  the  potential  for  labs  to 
further  coordinate  their  vork  vlth  the  other  Federally-funded  assistance 
institutions  listed  in  Table  1* 
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Study  the  future  of  services  to  the  Pacific  Basin  Region- 

The  panel  Is  aware  that  the  Northwest  Regional  Educational  Laboratory  Is 
providing  services  to  the  Pacific  Basin  Region.  This  region  covers  a 
vast  area,  ranging  from  Hawaii  In  the  east  to  Pacific  territories  In  the 
west.  The  area  Is  strategically  Important,  both  educationally  and 
otherwise. 

The  area  was  designated  a  separate  region  in  the  1985  re competition  of 
the  laboratories.  The  Northwest  lab  vas  assigned  to  help  the  region 
develop  full-service  capacity  to  operate  its  own  lab  by  the  close  of 
this  contract  period,  as  well  as  to  provide  services  to  It. 

The  panel  Is  not  In  a  position  to  comment  on  the  level  or  adequacy  of 
services  provided  to  the  region  by  the  Northwest  lab,  or  the  degree  of 
progress  made  In  preparing  the  region  to  have  Its  own  lab.  Nonetheless, 
It  strongly  recommends  that  OERI  study  the  future  direction  of  lab 
services  to  this  region  prior  to  commencing  the  1990  recompetltlon. 

More  examination  of  the  programs  In  the  field  la  needed- 

The  panel  recommends  that  In  the  future,  evaluations  of  whatever  sort 
(monitors*  visits,  external  reviews,  studies,  etc.),  should  seek  to  gee 
more  Information  from  the  people  in  the  field  with  whom  the  labs  work 
and  serve.  The  panel  recognizes  the  fiscal  constraints  on  obtaining  such 
Information,  I.e.  funds  for  staff  travel,  reviews  and  contracted 
studies.  It  nonetheless  encourages  OERI  to  get  as  much  "grass-roots" 
evidence  as  possible  to  ensuie  that  a  clear  and  concise  picture  of  how 
well  the  labs  are  working  Is  obtained. 


eric 
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8630  fonton  street 

silver  sprina  marylaM  20910 

telephone  (301)  588^5464 


macro  systems  inc. 


April  28,  1989 


Dr.  Bruno  Manno 

Acting  Assistant  Secretary  for 

Educational  Research  and  Improvement 
U.S.  Department  of  Education 
555  New  Jersey  Avenue,  N.W,,  Suite  600 
Washington,  D.C.  20208*5500 

Dear  Bruno: 

On  behalf  of  the  Laboratory  Review  Panel,  I  am  pleased  to  submit 
to  you  our  report  on  the  pending  recompetition  of  the  regional 
laboratories. 

Over  the  course  of  the  past  two  years,  the  Panel  has  reviewed 
many  aspects  of  the  laboratory  program.    In  this  document  we  have 
attempted  to  bring  together  our  reactions,  observations  and 
recommendations  regarding  the  forthcoming  recompetition. 

On  behalf  of  the  Panel,  I  would  like  to  expresb  thanks  to  the 
OERI  staff,  who  assisted  us  so  ably  in  our  efforts.    Although  our 
views  were  represented  in  the  final  report,  we  were  provided  with 
every  level  of  support  and  inspiration  by  a  most  dedicated  staff, 
including  David  Mack,  Barbara  Lieb-Brilhart,  Joyce  Stern  and  the 
institutional  monitors. 

We  express  special  thanks  to  Milt  Goldberg  for  his  support  in 
creating  the  panel  and  his  continuing  interest  in  our  work.  We 
especially  thank  Charles  Stalford  for  his  dedication  and  energy  in 
seeing  that  we  kept  on  track,  got  it  right  and  did  what  we  were  tasked 
to  do.    Without  question,  Charles  was  indispensable. 

We  hope  that  this  report  will  assist  you,  Nelson  Smith,  and  the 
OERI  staff  on  your  plan  for  the  1990  recompetition.    We  would  be 
pleased  to  meet  with  you,  to  discuss  our  report,  at  your  convenience. 


Christopher  T.  Cross 
Vice  Chairman 


cc : 


Nelson  Smith 
David  Mack 
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INFORMATION  ABOUT  THE  PANEL 


The  Laboratory  Review  Panel  (LRP)  is  an  external  advisory  group  established  in  1987  by 
the  Assistant  Secretary  for  the  Office  of  Educational  Research  and  Improvement  (OERI)  of 
the  U.S.  Department  of  Education. 

The  panel's  first  task  was  to  comment  on  an  external  review  of  individual  laboratories, 
sponsored  by  OERI,  in  the  summer  of  1987.  The  panel  submitted  a  report  to  the  Assistant 
Secretary  about  the  review  on  October  6,  1987  ("Report  of  the  Laboratory  Review  Panel 
on  the  1987  Review  of  Laboratories").  This  report  discussed  several  program-wide  issues 
raised  by  the  individual  laboratories'  external  reviews. 

The  panel  has  continued  to  meet  since  then,  and  has  been  asked  to  provide  advice  to  OERI 
regarding  policies  that  should  be  incorporated  in  the  laboratory  program  through  the 
recompetition  of  existing  contracts,  which  expire  in  November  1990.  Policies  incorporated 
in  and  through  the  recompetition  will  guide  the  program  through  the  period  1990-95. 

The  members  of  the  panel  are  as  follows: 

Mr.  Christopher  Cross  (Chair),  Vice  Chairman  and  Director,  Macro  Systems,  Inc.,  Silver 
Spring,  Maryland 

Dr.  Joy  Frechtiing,  Acting  Director,  Department  of  Educational  Accountability,  Montgomery 
County  Public  Schools,  Rockville,  Maryland 

Dr.  Ernest  House,  Professor,  Laboratory  for  Policy  Studies,  University  of  Colorado,  Boulder 

Dr.  Alexander  Law,  Elk  Grove,  California  (retired  from  position  as  Director,  Program 
Evaluation  and  Research  Division.  California  State  Department  of  Education) 

Dr.  Garry  McDaniels,  President,  Softwriters  Development  Corporation,  Linthicum,  Maryland 

Dr.  Carl  Sewell,  President,  Educative  Systems  Development  Corporation,  Plainfold,  New 
Jersey 

The  panel  is  solely  responsible  for  the  content  of  this  report.  No  official  endorsement  by 
OERI  or  the  Department  of  Education  should  be  inferred.  Also,  views  expressed  herein 
are  those  of  the  individual  panel  members  and  do  not  necessarily  reflect  those  of  the 
organizations  with  which  they  are  affiliated. 
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1.  INTRODUCTION 

The  panel  believes  that  periodic  recompetition  in  the  lab  program  is  valuable.  In 
accordance  with  "free  market"  philosophy,  the  panel  is  convinced  that  competition  provides 
an  opportunity  for  others  to  propose  new  and  better  ways  to  operate  laboratories.  The 
prospect  of  recompetition  also  serves  to  stimulate  delivery  of  higher  quality  services  and 
products  by  existing  holders  of  lab  awards. 

The  panel  has  been  asked  to  make  recommendations  to  the  Assistant  Secretary  of  OERI 
regarding  policy  for  the  pending  laboratory  recompetition.  With  this  end  in  mind,  this 
report  addresses  what  the  panel  believes  to  be  the  most  critical  issues  OERI  must  address 
in  the  recompetition.  For  each  set  of  issues,  it  offers  recommendations  regarding  desirable 
OERI  policy.  The  panel's  recommendations  are  stated  at  tne  beginning  of  each  section  of 
the  report  and  for  the  reader's  convenience,  are  also  restated  separately  in  Appendix  A. 

The  panel  met  on  February  23-24,  1989  to  formulate  its  recomme.  iations.  In  formulating 
these  recommendations,  the  panel  has  drawn  upon  a  wide  variety  of  inputs.  These  were 
policy  papers  commissioned  by  OERI  to  help  guide  recompetition  planning  (listed  in 
Appendix  B),  staff  papers,  the  panel's  prior  experience  with  the  program,  and  a  session 
with  laboratory  representatives  on  February  24. 

In  its  February  24  session  with  representatives  of  lab  governing  boards  and  executive 
directors,  which  was  open  to  the  public,  the  panel  engaged  in  a  productive  discussion  about 
the  current  status  and  operations  of  the  program.  Because  policy  in  a  pending  OERI 
procurement  was  involved,  Department  of  Education  of!  ;ials  had  ruled  that  the  panel  could 
not  discuss  the  recompetition,  or  the  future  of  the  program  with  the  representatives  in  this 
session. 

In  the  remainder  of  its  February  23-24  meeting,  the  panel  met  with  OERI  staff  and 
formulatrd  its  recommendations  for  this  report.  These  discussions  were  closed  to  the 
public. 

2.  ISSUES  AND  PANEL  RECOMMENDATIONS 
A.      Laboratory  Linkages  within  the  R&D  System 

The  panel  recommends  that  OERI  commission  a  high-level  and  wide-ranging  review 
of  the  characteristics  and  productivity  of  the  present  R&D  system  in  education. 

At  a  more  immediate  level,  the  panel  recommends  that  OERI  critically  reexamine  the 
relationships  within  ;ts  own  network  of  programs.  The  panel  specifically  recommends 
that: 
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(a)  OERI  immediately  reexamine  the  relationships  among  current  research, 
development,  and  dissemination  activities  of  its  institutional  R&D 
programs  (labs,  centers.  Educational  Resources  Information  Centers 
(ERIC)  and  the  National  Diffusion  Network  (NDN)  before  finalizing 
specification*  for  the  pending  recompgtition  of  labs  and  centers; 

(b)  OERI  require  labs  to  have  center  representatives  on  their  governing 
boards  and  centers  to  have  lab  representatives  on  their  advisory  boards; 

(c)  OERI  appoint  a  high  level  advisory  committee  of  representatives  of  labs. 
centers.  ERIC  and  the  NDN  to  help  it  gain  better  coordination  of  and 
more  productivity  from  the  various  parts  of  its  R&D  network; 

(d)  Department  of  Education  staff  representing  non-OERI  assistance 
programs  be  invited  to  participate  in  the  work  of  this  advisory 
committee; 

(e)  OERI  conduct  an  annua!  forum  for  representatives  of  its  major 
programs  to  share  information  about  new  developments,  succtsses  and 
failures,  and  any  other  information  that  would  enhance  the  productivity 
of  its  R&D  network. 


High  Level  Review  of  the  Educational  R&D  System  -  Most  of  the  panel's 
recommendations  deal  with  the  lab  program  itself.  And  most  of  them  are  framed  to 
recognize  the  reality  of  the  context  for  the  lab  recompetition.  For  example,  the  panel 
recognizes  present  budget  constraints  upon  labs  and  other  educational  programs. 

However,  the  pane]  believes  that  commissioning  a  thorough  reexamination  of  the 
educational  R&D  system  itself  is  the  most  importam  thing  OERI  can  do,  not  only  because 
of  the  competition,  but  also  because  of  its  investment  in  other  institutional  R&D  programs. 

The  present  R&D  system  of  labs,  centers,  and  other  institutional  programs  has  evolved  in 
numerous  and  not  always  logically  consistent  ways  since  those  prograns  were  established 
in  1965-66.  At  that  time,  with  the  passage  of  the  Elementary  and  Secondary  Education 
Act  (ESEA),  the  Federal  Government  vastly  increased  its  support  for  education,  including 
the  creation  of  the  lab  and  center  network. 

Among  major  changes  since  1965-66  that  should  affect  current  thinking  about  the 
educational  R&D  system  are  the  following: 
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o       Federal  support  for  large  scale  curriculum  development  (in  which  some  labs 
were  significantly  involved)  has  ended. 

o       There  has  been  an  increase  in  the  number  and  variety  of  R&D-based 

assistance  organizations  funded  outside  the  Department  of  Education  or  its 
predecessor  (HEW).  These  include  educational  service  agencies  and  other 
State  programs;  private  sector  firms;  and  agencies  not  necessarily  perceived 
as  "education^,"  but  which  nonetheless  provide  significant  educational 
services  (such  as  the  National  Endowments  for  the  Arts  and  Humanities). 

o       There  are  now  other  programs  for  dissemination  and  technical  assistance 
funded  by  the  Department  of  Education.  These  include  ERIC  and  NDN 
funded  by  OERI  and  targeted  assistance  programs,  such  as  Technical 
Assistance  Centers  for  Chapter  I  programs  (compensatory  education)  and 
Regional  Resource  Centers  for  P.L.  94-142  programs  (special  education). 

o       States  have  recently  assumed  a  much  stronger  leadership  role  in  educational 
reform. 

o       Sweeping  demographic  changes  in  the  nation's  student  population  are 
affecting  the  agenda  for  educational  R&D. 


Further,  some  of  the  assumptions  on  which  the  labs  were  built  have  proven  to  be  false. 
For  example,  one  assumption  was  that  labs  would  function  as  large  national  organizations, 
on  the  model  of  the  Brookhaven  Laboratory.  But  no  similar  approach  to  massive  funding 
of  national  labs  (or  a  reasonable  counterpart  in  the  context  of  educational  R&D)  ever 
materialized  in  the  lab  program.  And,  of  course,  the  educational  laboratories  evolved  into 
regional  organizations  rather  than  national  ones. 

The  panel's  own  sense  that  a  review  is  needed  was  reinforced  by  Dr.  James  Guthrie.  He 
recommends  a  high-level  review  of  the  R&D  system  in  his  policy  paper.  As  Guthrie 
states,  lacking  such  a  review,  alternative  recommendations  for  lab  policy  in  1990-95  are 
essentially  "interim"  ones,  even  if  productive. 

Such  a  review  would  look  at  the  number,  complexity  and  interrelationships  of  the  various 
parts  of  the  current  system.  It  would  ask  whether  the  parts  could  be  made  to  fit  together 
more  productively.  The  panel  believes  the  review  might  also  ask  whether  there  are  an 
appropriate  number  and  variety  of  institutional  groups  in  existence  now  to  conduct,  or  be 
supported  in  conducting,  educational  R&D. 

The  National  Academy  of  Sciences  -  OERI  should  consider  contracting  with  an 
organization  such  as  the  National  Research  Council  of  the  National  Academy  of  Sciences 
(NAS)  for  such  a  review.  This  organization  has  usefully  conducted  similar  high-level 
reviews  for  OERI  in  the  past,  most  recently  one  focused  on  the  OERFs  National  Center  for 
Educational  Statistics  (NCES). 
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There  art  several  advantages  to  having  an  outside  group  conduct  the  review.  One  is  that 
the  impartiality  and  credibility  of  the  review  would  be  enhanced.  Also,  many  of  the  finest 
thinkers  about  educational  R&D  in  the  country  would  likely  be  willing  to  participate.  The 
panel  recommends  that  participants  in  the  review  include  representatives  of  labs,  centers 
and  the  other  programs  directly  involved,  plus  their  constituents,  as  well  as  researchers, 
policy  analysts,  and  representatives  of  State  and  local  education  interests. 

Such  a  review  would  take  some  time  to  commission  and  conduct.  It  would  not,  therefore, 
interfere  with  conduct  of  the  present  recompetition.  But  it  could  shape  fundamental 
program  policies  in  the  years  ahead  A  valuable  by-product  of  the  review  would  be  the 
obtaining  of  more  information  from  the  field  about  the  value  of  various  R&D  organizations 
to  their  constituents  than  is  presently  available. 

Labs  and  Centers:  Immediate  Considerations  -  The  fundamental  assumption  that 
appears  to  underlie  OERTs  thinking  about  centers  and  labs  is  that  the  former  conduct 
research  and  the  latter  disseminate  research  and  provide  assistance  with  its  use.  This 
notion  presupposes  a  linear  R&D  process  (i.e.,  that  research  precedes  development  and 
dissemination,  etc.)  that  does  not  necessarily  exist  in  the  field.  The  linear  notion  also 
presupposes  a  fairl)  complete  separation  of  research  from  development  and  dissemination 
that  does  not  necessarily  exist.  Indeed,  centers  conduct  a  good  deal  of  dissemination,  and 
labs  conduct  some  applied  research.  Further,  some  labs  have  indicated  their  desire  to  place 
more  emphasis  on  longer  term  applied  research  and  development,  as  they  have  in  the  past. 

OERI  assumes  that  labs  and  centers  will  collaborate  in  complementary  (i.e.synergistic) 
fashion  in  the  performance  of  their  respective  functions.  In  fact,  a  good  deal  of  un- 
heralded collaboration  is  occurring,  not  only  labs  and  centers,  but  with  ERIC  and  NDN  as 
well.  Nonetheless,  the  panel  has  sufficient  evidence  from  its  various  inquiries  since  1987 
to  believe  that  more  can  and  should  be  done  to  improve  the  relationships  between  labs  and 
other  programs  funded  by  OERI  and  hence  the  productivity  of  OERTs  own  network  in  the 
R&D  system.  (The  panel  recommended  that  OERI  put  more  effort  into  fostering 
collaboration  between  labs  and  other  departmental  programs  in  its  1987  report.) 

The  panel's  recommendations  in  this  section  are  intended  to  strike  a  balance  between 
actions  that  can  have  immediate  impact  (the  review  of  OERTs  own  network,  etc.)  and  those 
which  will  have  a  longer-term  impact  (the  high-level  review). 
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B.      Future  Laboratory  Mission 


The  panel  recommends  that,  consistent  with  legislative  direction,  OERI  reformulate 
the  mission  for  the  lab  program  to  provide  greater  clarity  and  focus  in  the  coming 
recompetition. 

The  present  mission  of  the  laboratory  program  is  not  sufficiently  clear. 

Part  of  the  difficulty  is  due  to  lack  of  clarity  about  presumed  relationships  among  labs, 
centeis  and  other  components  of  the  R&D  system,  as  discussed  in  the  previous  section. 

Part  of  the  problem  may  be  the  way  in  which  goals  of  the  program  are  stated  in  the 
present  OERI  guidelines.  The  1985  OERI  Request  for  Proposals  stated  that  labs  should 
"focus  on  school  and  classroom  improvement"  When  interpreted  broadly,  school  and 
classroom  improvement  can  encompass  almost  all  types  of  educational  R&D.  Those 
guidelines  do  not  provide  adequate  operational  direction  about  what  labs  should  and  should 
not  do. 

Program  Delivery  Strategy  and  the  Mission  -  An  additional  factor  affecting  the  lack  of 
clarity  of  the  program's  mission  is  that  a  substantial  portion  of  the  labs'  resources  are 
directed  by  OERI  guidelines  to  be  delivered  via  an  indirect  service  strategy. 

A  prominent  part  of  this  strategy  is  that  the  labs  are  to  work  "with  and  through"  existing 
organizations  to  improve  schools  and  classrooms"through  R&D-based  strategies.  Pursuant 
to  the  indirect  service  strategy,  labs  participate  in  strengthening  others'  organizational 
support  systems  (e.g.,  through  capacity-building  or  training  of  trainers)  and  work  with 
various  intermediaries  in  a  large  number  of  ways,  rather  than  working  directly  with  schools 
and  classrooms. 

On  the  one  hand,  the  degree  of  client-responsiveness  generated  by  labs'  cooperative  efforts 
under  the  indirect  service  strategy  is  good.  On  the  other  hand,  this  strategy  leads  to  a 
situation  where  the  distinctive  mission  of  the  program  tends  to  get  blurred.  (The  strategy 
is  discussed  in  more  detail  in  Section  C  below.) 

Contextual  Factors  Affecting  the  Lab  Mission  -  Any  refinement  of  the  labs'  mission 
must  obviously  take  into  account  statutory  requirements  for  the  program.  The  OERI 
authorizing  legislation  requires  that  regional  agendas  set  by  lab  governing  boards  be 
consistent  with  OERI's  "priority  research  and  development  needs."  (The  first  two  of  these 
are  increasing  student  achievement  and  providing  equal  educational  opportunity.) 

In  addition,  the  legislation  specifies  that  applicants  for  labs  and  centers  will  conduct  a 
specified  range  of  activities,  including  research  and  development,  dissemination  and 
technical  assistance  and  that  the  activities  will  be  consistent  with  OERI's  research  and 
development  program.  However,  none  of  these  statutory  requirements  appears  to  the  panel 
to  constrain  possible  refinement  of  the  lab  program  mission. 
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One  contemporary  contextual  issue  is  the  extent  to  which  the  lab  mission  should  be  driven 
by  the  needs  of  chief  state  school  officers  or  other  State  officials  in  the  current 
environment  of  State-led  educational  reform. 

In  a  policy  paper  written  for  OERI,  David  Hornbeck,  the  former  chief  State  school  officer 
in  Maryland,  suggests  labs  should  be  much  more  responsive  to  the  needs  of  the  chiefs. 
Conversely,  in  its  discussion  of  the  present  status  of  the  program  with  lab  representatives, 
the  panel  was  told  that  the  present  emphasis  upon  the  needs  of  chief  state  school  officers 
was  about  right  and  that,  if  anything,  labs  should  be  more  able  to  meet  to  the  needs  of 
other  constituencies  in  their  regions.  While  the  role  of  the  chiefs  is  a  significant  issue,  the 
panel  does  not  believe  a  mission  statement  for  the  entire  program  needs  to  force  an  "either- 
or  position  on  that  issue  to  be  viable. 

Characteristics  of  a  Better  Mission  Statement  -  No  one  mission  statement  will  resolve 
all  ambiguities  about  what  the  labs  should  do,  but  the  panel  does  believe  some  refinement 
of  the  program's  mission  statement  should  be  undertaken. 

In  principle,  a  mission  statement  should  be  broad  and  focus  on  outcomes  rather  than 
processes.  In  this  case,  the  panel  recommends  a  two-part  structure  for  the  lab  program 
mission.  The  first  part  would  be  a  brief  and  general  statement  of  what  the  labs  should  do 
at  the  program  level.  The  second  part  would  be  the  presentation  of  clear  and  measurable 
objectives  by  individual  labs  for  their  regions.  For  example,  a  lab  should  be  expected  to 
state  (a)  what  educational  problems  it  expects  to  focus  on,  (b)  what  bodies  of  R&D-based 
knowledge  it  expects  to  use  in  its  work,  and  (c)  the  specific  benefits  it  expects  to  be 
realized  within  the  5  year  period  of  its  award. 

For  illustrative  purposes,  the  panel  offers  two  alternative  mission  statements  at  the  first 
(general)  level  in  Appendix  C. 

(The  panel  realizes  that  some  contextual  factors  will  inevitably  change  during  the  course  of 
a  5  year  lab  award.  However,  OERI  can  require  applicants  in  the  recompetition  to  propose 
objectives  that  are  sufficiently  specific  to  be  critically  reviewed  on  a  comparative  basis, 
while  at  the  same  time  acknowledging  the  need  for  flexibility  in  planning  that  may  arise 
during  the  course  of  the  5  year  awards.) 


C.      Strategy  for  Delivery  of  Services 

The  panel  recommends  that  OERI  revise  its  approach  to  the  indirect  service  strategy 
in  the  recompetition.  Labs  should  be  allowed  more  flexibility  in  their  choice  of 
strategies  to  serve  their  regions. 

In  the  recompetition.  applicants'  choice  of  service  delivery  strategies  should  be  judged 
bv  the  promise  they  have  for  helping  to  attain  stated  regional  objectives. 
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The  present  OERI  policy  for  delivery  of  lab  services,  particularly  the  indirect  service 
strategy  discussed  briefly  above,  is  perhaps  one  of  two  or  three  topics  that  have  most 
occupied  the  panel  since  its  creation  in  1987.  (Another  is  the  lab  mission,  just  discussed.) 

Labs  are  primarily  oriented  to  dissemination  and  assistance  strategies  under  present  OERI 
guidelines.  As  indicated  in  the  previous  section,  labs  ait  to  work  "with  and  through" 
existing  groups,  such  as  education  service  agencies  and  State-level  decisionmakers,  to 
improve  schools  and  classrooms  under  these  guidelines. 

(Some  lab  work  if  not  subject  to  this  strategy.  In  addition,  OERI  staff  believe  the  labs 
sometimes  misunderstand  the  indirect  service  strategy,  particularly  the  extent  to  which  labs 
may  actually  work  with  local  school  districts  and  schools.  Labs  can  work  directly  with 
individual  school  districts,  schools  and  classrooms  under  a  number  of  circumstances.  These 
include  cases  where  there  are  few  assisting  organizations  with  whom  a  lab  can  work  and 
where  schools  and  classrooms  wish  to  serve  as  pilot  sites  for  products  or  services  the  labs 
have  developed.  In  general,  however,  OERI's  guidelines  for  work  towards  school  and 
classroom  improvement  emphasize  working  with  and  through  others.) 

OERI's  rationale  for  implementing  the  indirect  service  strategy  in  1985  was  straightforward. 
With  some  16,000  school  districts  in  the  country,  the  nine  labs  lacked  the  resources  to 
work  directly  with  a  significant  number  of  them. 

As  a  related  matter,  the  1985  OERI  guidelines  re-oriented  the  labs'  work  in  producing 
R&D-based  products  (guidelines  for  instruction,  staff  development,  summaries  of  research, 
etc.)  After  1985,  labs*  product  development  was  focused  on  short-term  projects  that 
assisted  their  dissemination  and  assistance  strategies,  rather  than  longer-term  and  more 
ambitious  projects  (e.g.,  development  of  an  entire  basic  skills  program)  that  some  of  the 
labs  had  engaged  in  before. 

Lab  Viewpoints  -  In  the  open  session  at  the  last  panel  meeting,  lab  representatives  spoke 
about  both  advantages  and  problems  of  the  indirect  service  strategy.  One  representative 
said  that  the  strategy  did  not  represent  much  of  a  change  from  what  his  lab  had  been 
doing  previously.  Another's  view  was  that  the  strategy  was  helpful  in  encouraging  the  labs 
to  expand  their  involvement  with  other  agencies  in  the  region. 

Among  the  problems  cited  by  lab  representatives  were  that  they  had  to  take  long  periods 
of  time  to  establish  working  relationships  with  organizations  that  did  not  lead  to  any 
discernible  result,  and  that  much  of  the  work  under  the  strategy  either  diluted  the  lab's 
impact  or  showed  unimpressive  or  fragmented  results. 

Reflecting  on  its  accumulated  perceptions  of  this  topic,  the  panel  believes  OERI  has  gone 
too  far  in  its  present  requirements  for  the  indirect  service  strategy.  Even  with  exceptions, 
the  present  guidelines  tend  to  place  the  strategy  in  a  "first  among  equals'1  status  with  other 
possible  strategies  for  service  delivery. 

On  the  other  hand,  the  strategy  does  have  a  place  in  the  array  of  ways  in  which  labs  might 
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work  with  regional  constituencies.  The  panel  believes  the  issue  is  one  of  balance,  rather 
than  either-or.  The  thrust  of  the  panel's  recommendations  in  this  area  is  therefore  to 
provide  the  labs  with  more  flexibility. 

D.      Program  Evaluation 

The  panel  recommends  that  the  emphasis  in  lab  self  assessment  in  the  next  award 
period  be  on  evaluation  to  improve  program  operations  (formative  evaluation).  Such 
evaluation  should  address  the  questions  "Was  the  progran:  Implemented  as  agreed- 
upon?"  and  "How  well  was  it  implemented?" 

If  lab  self-assessment  focuses  on  evaluation  for  self-improvement  in  the  future,  there 
will  be  an  unacceptable  gap  in  OERTs  capacity  to  develop  summative  information 
about  the  impact  of  the  program  for  purposes  of  accountability  and  policymaking. 
The  panel  therefore  recommends  that  OERI  request  the  Congress  to  provide  sufficient 
funds  in  the  future  to  allow  OERI  to  conduct  the  necessary  summative  evaluation. 

Three  basic  types  of  program  evaluation  questions  can  be  asked:  (1)  Was  the  program 
implemented  as  agreed-upon?  (2)  How  well  was  the  program  implemented?  (3)  What 
happened  as  a  result  of  the  program  being  implemented? 

Lab  self-assessments  have  generated  a  good  deal  of  information  in  response  to  the  first  two 
questions,  but  relatively  little  in  response  to  the  third  (impact).  One  lab  director  directly 
told  the  panel  that  his  lab  was  capable  of  doing  the  type  of  study  that  would  provide 
information  about  impact,  but  preferred  to  put  the  money  into  regional  services. 

The  panel's  work  has  been  hampered  by  OERI's  own  lack  of  funds  to  conduct  impact 
evaluations.  OERI  has  developed  a  comprehensive  plan  for  evaluation  of  labs  during  this 
contract  period,  but  has  had  available  only  a  fraction  of  the  funds  necessary  to  carry  it  out. 

Evaluative  information  which  has  been  made  available  to  the  panel,  notably  through  the 
OERI's  1987  external  review  of  individual  labs,  has  focused  largely  on  process  (questions  1 
and  2  above).  In  fact,  on  that  dimension,  the  labs  appear  to  rate  quite  highly.  But  the 
panel  has  no  conclusive  information  about  the  impact,  or  benefits  to  the  country,  from  the 
lab  program. 

The  panel  does  not  believe  it  is  realistic  to  expect  the  labs  to  provide  conclusive  evidence 
about  impact.  Their  concerns  tend  towards  information  to  improve  operations.  Further, 
there  is  an  inherent  issue  of  credibility  of  findings  about  impact  from  a  lab  (or  any  other 
organization)  derived  from  its  self  evaluation.  The  panel's  recommendations  therefore 
suggest  an  appropriate  division  of  labor  between  the  labs  and  OERI  for  evaluation. 
Unfortunately,  the  present  budgetary  climate  is  not  encouraging  insofar  as  OERI's  ability  to 
do  impact  studies  in  the  foreseeable  future  is  concerned.  The  panel's  second 
recommendation  is  intended  to  address  this  situation. 
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E.      Equitable  Distribution  of  Funds 


The  panel  recommends  that  OERI  take  feasible  steps  to  reduce  the  flaring  inequities 
in  the  existing  per-pupil  funding  capacity  of  labs. 

o       OERI  should  request  the  Congress  to  incorporate  present  year-to-year 
appropriations  for  the  lab  rural  initiative  into  continuing  funding  of  the 
program's  institutional  base.  OERI  should  then  make  those  funds 
available  for  all  program  activities  and  re-allocate  them  among  the  labs 
in  a  way  to  reduce  the  regional  funding  inequities. 

o       OERI  should  consider  the  possibility  that  any  re-allocation  of  funds 

brought  about  by  the  competition  for  a  lab  in  the  Pacific  Basin  Region 
in  1990  may  provide  a  further,  although  smaller,  way  to  reduce  regional 
funding  inequities. 


The  panel  has  reviewed  alternative  OERI  approaches  to  the  allocation  of  funds  to  lab 
regions  in  the  1985  recompetition.  (OERI  examined  this  matter  systematically  in  the  1985 
recompetition.  For  the  first  time,  non-overlapping  boundaries  were  established  for  lab 
regions  in  which  all  areas  of  the  country,  including  Hawaii  and  the  Pacific  territories,  were 
served.) 

Establishing  an  equitable  basis  for  regional  distribution  of  lab  funds  is  a  complex  process. 
Among  the  many  factors  to  consider  are  the  number  of  States,  the  size  of  the  elementary 
and  secondary  student  population,  and  the  geography  and  population  density  of  the  region. 
In  addition,  six  of  the  present  nine  labs  have  been  in  existence  for  more  than  two  decades. 
As  a  result,  there  are  political  factors  present,  based  on  historical  precedents  and 
expectations  regarding  the  level  of  funding  for  these  labs.  These  expectations  are  held  by 
legislators  and  constituents,  as  well  as  the  labs  themselves. 

OERI's  approach  to  equitable  funding  in  1985  involved  three  specific  factors:  (a)  a  more 
less  fixed  amount  OERI  judged  necessary  for  any  lab  to  support  its  institutional  functions 
of  organization,  management  and  governance;  (b)  the  number  of  States  in  the  region;  and 
(c)  the  population  of  elementary  and  secondary  school  students  in  public  and  private 
schools  in  *he  region. 

Per-Student  Spending  Capacity  -  OERI  sought  a  workable  accommodation  to  these 
factors  in  1985.  The  panel  does  not  criticize  the  1985  funding  allocations.  But  one  aspect 
of  the  resulting  allocations  needs  attention  in  the  pending  recompetition. 

The  1985  funding  allocations  derived  from  the  three  factors  above  leave  considerable 
variance  in  the  capacity  for  per-student  expenditures  that  the  labs  are  capable  of  making 
within  their  regions.  In  fact,  the  ratio  of  the  highest  per-student  expenditure  that  a  lab  can 
make  to  the  lowest  is  roughly  10:1.  The  panel  recognizes  that  the  factors  affecting  costs 
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arc  so  complex  that  full  equity  is  probably  not  possible.  However,  there  is  no  justification 
for  continuing  a  disparity  of  the  present  magnitude. 

The  per-student  expenditure  calculation  is  an  analytical  tool.  It  does  not  mean  that  each 
lab  actually  spends  that  amount  per-student.  Nor  is  it  the  only  way  to  view  lab 
allocations.  However,  the  per-student  figure  is  a  good  indicator  of  the  vastly  different 
challenges  that  individual  labs  face  when  serving  their  regions.  A  lab  with  a  high  per- 
student  allocation  can  plan  and  deliver  a  more  aggressive  strategy  for  penetrating  its  region 
with  services  and  products  than  one  with  a  low  per-student  allocation.  The  latter  type  lab 
will,  taking  into  account  the  relatively  small  percent  its  funds  represent  of  total  regional 
expenditures  for  education,  be  forced  into  a  less  central  role  in  its  region. 

"Less  central"  does  not  necessarily  mean  a  lab  will  be  inconsequential.  (The  median 
funding  per  lab  at  present,  including  rural  programs,  is  approximately  $2  million).  Nor 
does  it  mean  that  die  lab  cannot  be  useful.  It  does  mean  that  in  most  such  cases  the  lab 
will  be  a  smaller  fish  in  a  bigger  pond.  It  will  likely  be  obliged  to  "tag  onH  on  to  other 
initiatives,  or  leverage  its  services  through  intermediaries  to  a  greater  extent.  (This  factor 
clearly  has  implications  for  how  a  lab  would  conceive  of  its  service  delivery  strategy,  as 
discussed  earlier  in  this  report.) 

Possible  Steps  -  "Levelling  up"  funding  of  all  labs  to  the  per-student  level  of  the  •'richest" 
one  would  not  be  easy  to  do,  and  may  not  be  the  most  equitable  formulation.  Again,  that 
is  because  student  population  was  only  one  of  three  factors  in  OERTs  regional  allocations 
in  1985.  If  weighting  of  the  other  two  factors  (a  fixed  amount  for  lab  institutional 
functions  and  the  number  of  States  in  the  region)  was  held  constant,  manipulation  of 
funding  based  on  the  pupil  population  factor  would  not  produce  a  direct  1:1  change  in  the 
overall  disparity  in  per-student  capacity  that  is  now  observable. 

In  any  event,  "levelling  up"  funding  of  labs  to  equalize  their  per-student  funding  capacity 
would  be  prohibitively  expensive.  Conversely,  Mlevelling-downM  the  funding  of  some  labs 
to  equalize  the  per-student  allocations  would  be  practically  and  politically  unfeasible. 

The  panel  does  believe  that  circumstantial  factors  in  the  pending  recompetition  do  provide 
a  possible  way  to  reduce  the  levels  of  inequity  in  present  per-student  funding  capacity  of 
labs. 

The  first  factor  is  the  current  year-to-year  appropriations  for  the  lab  rural  initiative,  now  in 
its  third  year.  If  these  funds  ($5,138  million  in  FY  89)  could  be  incorporated  into  the  lab 
program's  regulir  base  and  made  available  for  all  activities,  the  additional  money  could  be 
re-allocated  in  a  way  to  reduce  the  per-student  inequities. 

The  second  factor  is  the  competition  which  will  occur  in  the  Pacific  Basin  Region  for  the 
first  time  in  1990.  (This  region  includes  Hawaii  and  several  trust  territories.)  In 
accordance  with  a  decision  made  as  part  of  the  1985  recompetition,  the  Northwest  Lab  has 
been  serving  this  region  while  preparations  were  being  made  for  a  separate  lab  to  serve  the 
region  in  1990  and  thereafter. 
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It  may  be  necessary  to  reallocate  funds  among  the  labs  to  provide  funds  for  the  new 
Pacific  Basin  Region.  If  so,  an  opportunity  may  exLt  on  a  smaller  scale  to  further  reduce 
existing  inequities  in  funding  among  the  regions. 

F.      Outside  Funding  of  Laboratories 

The  panel  recognizes  that  labs  have  a  legal  right  to  seek  outside  funds:  nevertheless, 
it  recommends  that  OERI  review  such  activities  as  necessary  to  ensure  that  the  labs' 
ability  to  conduct  work  pursuant  to  their  core  regional  mission  is  not  jeopardized. 

The  panel  farther  recommends  that  OERI  ensure  that  its  funds  are  not  used  by  labs 
to  subsidize  costs  of  writing  proposals  for  outside  funding  or  otherwise  positioning 
themselves  to  receive  outside  funding. 

In  its  1987  report  to  the  Assistant  Secretary,  the  pane)  recommended  that  the 
"entrepreneurial"  behavior  of  labs  in  seeking  funds  outside  those  from  OERI  be  studied 
further  prior  to  the  recompetition.  (At  present,  OERI  believes  that  labs'  outside  funding  as 
a  percent  of  their  total  funding  on  an  individual  basis  ranges  from  less  than  5  percent  to 
approximately  50  percent  The  median  probably  approximates  15  percent) 

The  panel  is  concerned  about  acquisition  of  outside  funds  for  a  number  of  reasons.  First, 
these  entrepreneurial  efforts  may  divert  the  labs  from  their  OERI-funded  mission.  Second, 
the  commitment  of  key  personnel  to  the  OERI  contract  may  be  lost  or  reduced  through 
diversion  to  other  projects  and  priorities.  Third,  as  a  result  of  OERTs  funding  for  their 
institutional  functions,  OERI  may  unintentionally  be  subsidizing  labs  to  compete  with  others 
r*>r  outside  work  in  the  field. 

Of  special  concern  is  assuring  that  activities  in  support  of  preparing  proposals  for  outside 
funding  are  not  being  included  in  the  pool  of  costs  used  to  establish  the  labs9  indirect  cost 
rate.  (The  evidence  on  this  general  set  of  concerns  is  inconclusive,  but  numerous  outsiders 
have  raised  the  question  of  whether  labs  are  enabled  to  compete  unfairly  with  others 
because  of  their  institutional  support  from  OERI.) 

In  their  meeting  with  the  panel,  lab  representatives  generally  defended  their  work  outside 
the  OERI  lab  contracts.  Among  the  arguments  they  cited  were  that  the  outside  work 
contributed  to  the  labs*  overall  capabilities,  served  to  strengthen  the  R&D  ,,infra-structure,H 
and  did  not  pose  a  threat  to  OERI-funded  work. 

The  lab  representatives  acknowledged  some  differences  among  themselves  over  the  issue  of 
outside  funding  in  the  past.  They  told  the  panel,  however,  that  uncertainty  of  funding  in 
recent  years  has  tended  to  bring  them  together  on  the  subject. 
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Labs'  acquisition  of  outside  funds  does  has  advantages.  One  is  that  it  makes  labs  less 
dependent  upon  OERI  funding  for  survival.  Another  is  that  outside  funding  potentially 
makes  labs  more  sensitive  to  market  forces  and  needs  in  their  regions. 

The  panel  understands  that  OEM's  monitoring  practices  in  this  area  during  the  current 
contract  period  have  led  to  three  rules  of  thumb  when  weighing  the  desirability  of  a  lab's 
seeking  outside  funds  in  specific  instances.  These  rules  are  that  (a)  the  activities  to  be 
funded  from  outside  would  not  be  inconsistent  with  the  lab's  regional  mission;  (b)  the 
outside  funding  would  not  dilute  performance  on  OERI-funded  work;  and  (c)  the  outside 
funding  would  not  take  the  lab's  resources  outside  its  region.  The  panel  believes  that 
OERI  should  continue  to  follow  this  approach  in  monitoring  labs'  outside  activities  in  the 
future. 


G.      Procurement  Mechanism  for  New  Awards 

The  panel  recommends  that  the  Department  of  Education  ask  the  Congress  to 
consider  establishing  a  new  form  of  procurement  instrument  that  woulc  be  better 
suited  to  the  lab  program  (and  possibly  other  programs  as  well)  than  the  existing 
ones.  Such  an  instrument  should  both  protect  the  legal  rights  of  the  labs  and  the 
Government  and  still  allow  the  labs  a  reasonable  degree  of  flexibility  in  planning  and 
implementing  their  programs  over  the  5  year  period  of  the  new  awards. 

Should  such  a  new  instrument  not  be  available,  the  panel  would  recommend  the  use 
of  contracts,  among  the  existing  alternatives. 

The  panel  also  considered  a  mix  of  grants  and  contracts  in  the  recompetition.  For 
example,  contracts  could  be  used  to  procure  labs*  institutional  functions  and  grants 
could  be  used  to  assist  their  regional  services.  However,  the  panel  recognizes  that  the 
logistical  problems  that  would  be  presented  by  running  concurrent  competitions  may 
be  insurmountable. 

In  any  event,  the  panel  is  concerned  that  the  Department  of  Education  is  not  taking 
maximum  advantage  of  the  existing  discretionary  powers  to  facilitate  contract 
administration  that  are  vested  in  its  lab  staff  as  Contracting  Officers'  Technical 
Representatives  (COTR's),  The  panel  therefore  recommends  that  OERI  explore  with 
the  Department's  contracts  office  ways  in  which  administration  of  lab  contracts  could 
be  made  more  efficient  and  less  burdensome  through  greater  exercise  of  the  COTR's 
powers. 

Contracts  as  presently  used  are  not  well-suited  to  administration  of  the  lab  program. 
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In  its  1987  report,  the  panel  expressed  its  interest  in  the  efficiency  and  productivity  of  the 
organizational  and  contractual  relationships  between  the  labs  and  OERI.  It  also  expressed 
concern  about  the  specificity  of  contracts: 

The  panel  believes  that  the  specificity  of  contracts  emphasizes  process  at  the 
expense  of  (1)  a  concept  of  overall  jab  role  (2)  substantive  emphasis  (3)  vision  of 
successful  service  and  (4)  indicators  of  success. 

In  1987,  the  panel  further  stated  a  concern  that  contracts  appear  to  impose  an  unrealistic 
degree  of  precision  upon  labs  to  state  in  advance  what  they  plan  to  do  in  future  years,  at 
least  beyond  the  current  and  succeeding  year. 

Contracts  ait  ordinarily  used  when  the  Government  wishes  to  purchase  something,  for  its 
own  or  others*  use.  Grants,  by  comparison,  arc  used  when  the  Government  wishes  to  lend 
assistance  to  others.  In  the  abstract,  grants  would  thus  appear  well  suited  to  the  lab 
program. 

Nonetheless,  from  the  lab  viewpoint,  there  are  several  significant  disadvantages  to  grants. 
They  are  as  follows: 

o       the  labs  believe  the  specificity  and  legally-binding  nature  of  a  contract  (it  is 
signed  by  both  parties,  while  a  grant  is  only  signed  by  the  issuer)  help 
prev  nt  arbitrary  actions  by  the  funding  agency 

o       a  contractor  has  the  right  to  appeal  the  terms  of  an  involuntary  termination 
to  a  contract  appeals  board 

o       under  a  contract,  labs  can  receive  a  management  fee. 


The  fee  issue  has  been  a  troublesome  one  since  1985.  The  Federal  Acquisition  Regulations 
(FAR)  allow  the  use  of  no-fee  contracts  for  R&D.  OERI  issued  cost-reimbursable,  no-fee 
contracts  as  a  result  of  the  1985  recompetition.    Labs  would  like  to  have  fees.  Such  fees 
would  allow  them  to  finance  receivables  pending  reimbursement  of  expenses  from  the 
Government;  build  up  reserves  for  adverse  contingencies,  such  as  disallowance  of  costs 
through  later  audits;  and  be  used  for  institution-building  purposes.  As  indicated  in  its  1987 
report,  the  panel  is  sympathetic  to  the  labs'  position  regarding  the  fee  issue. 

Aside  from  the  labs*  preference  for  contracts,  OERI  staff  told  the  panel  they  have  other 
concerns  about  the  use  of  grants.  One  is  that  OERI  would  have  quite  limited  powers  to 
specify  the  work  to  be  done  and  the  "deliverables"  (products)  resulting  from  it.  OERI's 
ability  to  determine  such  things  would  be  largely  limited  to  rather  general  specifications  in 
the  Department  of  Education  General  Administrative  Regulations  (EDGAR),  and  OERI 
program  regulations,  which  cover  centers  as  well  as  labs. 
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The  panel  briefly  explored  the  possibility  of  using  cooperative  agreements  in  the  program. 
These  agreements  are  a  special  form  of  a  grant.  Under  them,  however,  the  Government 
participates  more  closely  in  the  work  with  the  "grantee"  and  correspondingly  assumes  a 
greater  degree  of  responsibility  for  its  success  or  failure. 

Three  difficulties  with  cooperative  agreements  in  the  lab  program  are  that  (1)  assumption 
by  OERI  of  greater  responsibility  for  the  programs  under  the  agreements  is  not  consonant 
with  the  statutory  responsibility  of  regional  boards  for  governance  of  the  labs;  (2)  it  is  not 
clear  that  OERI  could  bear  the  fiscal  and  staffing  burden  (e.g.,  of  travel)  to  work  closely 
with  the  labs  in  the  manner  envisioned  by  a  cooperative  agreement;  and  (3)  as  a  form  of 
grant,  cooperative  agreements  would  bear  no  fee. 

In  general,  the  panel  is  not  satisfied  with  any  of  the  existing  procurement  options  for  the 
program  in  the  1990-95  period;  hence,  its  recommendation  that  OERI  seek  a  new 
procurement  instrument  from  the  Congress. 

H.      Means  to  Facilitate  Competition 

The  panel  recommends  that  CSRI  take  every  feasible  step  to  stimulate  actual 
competition  in  the  forthcoming  recompetition. 

o       OERI  should  make  publicly  available  the  various  papers  and  studies  it 
has  commissioned  to  help  its  recompetition  planning.  These  include 
policy  papers,  findings  from  contracted  studies,  records  of  advice  from 
any  other  sources  it  has  solicited,  minutes  of  the  panel's  meeting  with 
lab  representatives  in  February  1989.  the  panel  s  1987  report  on  the 
external  review  of  individual  labs  and  this  report. 

o       Notice  of  the  availability  of  these  materials  should  be  made  as  promptly 
as  possible. 

o       OERI  should  allow  at  least  3  months  for  response  to  the  solicitation  in 
order  to  facilitate  preparation  of  high  quality  proposals  from  many 
sources. 

o       OERI  should  structure  the  solicitation,  particularly  the  proposal 
evaluation  criteria,  to  accommodate  the  legitimate  needs  of 
nonincumbents;  for  example,  by  giving  due  credit  for  excellence  of  plans 
and  staffing  and  not  over-weighting  existing  organizational  capacity. 

o       OERI  should  not  require  non-incumbent  applicants  to  gain  commitments 
to  serve  on  lab  governing  boards  from  chief  State  school  officers  and 
similar  regional  officials  as  a  condition  of  their  applications.  Reasonable 
plans  for  obtaining  such  commitments  after  the  award  if  a 
nonincumbent  is  funded  should  be  acceptable, 
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As  stated  at  the  beginning,  the  panel  believes  competition  is  valuable  for  the  lab  program. 


Conducting  a  competitive  procurement,  however,  does  not  guarantee  the  presence  of 
competitors,  i.e.,  more  than  one  applicant  for  each  award  per  lab  region.  The  panel 
recognizes  that  formulating  a  lab  proposal  is  a  formidable  task.  Under  present  guidelines, 
nonincumbent  applicants  Mill  have  to  form  a  brand  new  organization,  gain  numerous 
commitments  to  participate  in  a  regional  governing  board,  and  plan  a  complex  program  of 
work. 

A  particularly  daunting  task  for  nonincumbents  applicants  is  to  gain  commitments  from 
chief  state  school  officers  and  other  significant  officials  to  serve  on  their  governing  boards. 
Many  if  not  most  of  these  officials,  particularly  the  chiefs,  probably  serve  on  the  existing 
labs'  governing  boards.  Nonincumbents  are  therefore  not  in  a  good  position  to  request 
their  commitment  to  another  lab,  if  funded. 

But  the  198S  lab  recompetition  demonstrated  that  numerous  people  and  organizations  not 
currently  holding  lab  contracts  could  be  motivated  to  compete.  The  panel  believes  that 
stimulation  of  competition  by  nonincumbents  is  good  for  the  program  as  a  whole,  existing 
la^s  included,  just  as  vigorous  competition  in  elections  is  good  for  the  American 
democratic  system  of  government. 

The  absence  of  funds  for  planning  grants,  as  were  used  in  198S,  will  make  the  task  for 
nonincumbents  harder.  Still,  the  panel  believes  that  OERI  can  take  vital  steps  to  facilitate 
the  preparation  of  high  quality  proposals  by  all  applicants  and  to  enable  nonincumbents  to 
prepare  actually  competitive  proposals.  These  steps,  as  described  in  the  panel's 
recommendations  include  (1)  provision  of  full  information  to  all  prospective  competitors, 
(2)  providing  ample  time  for  preparation  of  proposals  and  (3)  structuring  the  solicitation  to 
accommodate  the  legitimate  needs  ot  lion-incumbents. 
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APPENDIX  A 
RESTATEMENT  OF  PANEL  RECOMMENDATIONS 


The  panel's  recommendations  are  restated  below  in  their  entirety  for  the  reader's 
convenience. 

A.      Laboratory  Linkages  within  the  R&D  System 

The  panel  recommends  that  OERI  commission  a  high-level  and  wide-ranging  review  of  the 
characteristics  and  productivity  of  the  present  R&D  system  in  education. 

At  a  more  immediate  level,  the  panel  recommends  that  OERI  critically  reexamine  the 
relationships  within  its  own  network  of  programs.  The  panel  specifically  recommends  that: 

(a)  OERI  immediately  reexamine  the  relationships  among  current  research, 
development,  and  dissemination  activities  of  its  institutional  R&D  programs 
(labs,  centers,  Educational  Resources  Information  Centers  (ERIC)  and  the 
National  Diffusion  Network  (NDN)  before  finalizing  specifications  for  the 
pending  recompetition  of  labs  and  centers; 

(b)  OERI  require  labs  to  have  center  representatives  on  their  governing  boards 
and  centers  to  have  lab  representatives  on  their  advisory  boards; 

(c)  OERI  appoint  a  high  level  advi.ory  committee  of  representatives  of  labs, 
centers,  ERIC  and  the  NDN  to  help  it  gain  better  coordination  of  and  more 
productivity  from  the  various  parts  of  its  P&D  network; 

(d)  Department  of  Education  staff  representing  n^fi-OERI  assistance  programs  be 
invited  to  participate  in  the  work  of  this  advisory  committee; 

(e)  OERI  conduct  an  annual  forum  for  representatives  of  its  major  programs  to 
share  information  about  new  developments,  successes  and  failures,  and  any 
other  information  that  would  enhance  the  productivity  of  its  R&D  network. 


B.      Future  Laboratory  Mission 

The  panel  recommends  that,  consistent  with  legislative  direction,  OERI  reformulate  the 
missior  Tor  the  lab  program  to  provide  greater  clarity  and  focus  in  the  coming 
recompcution. 


0 
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C.      Strategy  for  Delivery  of  Services 


The  panel  recommends  that  OERI  revise  its  approach  to  the  indirect  service  strategy  in  the 
recompetition.  Labs  should  be  allowed  more  flexibility  in  their  choice  of  strategies  to 
serve  their  regions. 

In  the  recompetition,  applicants'  choice  of  service  delivery  strategies  should  be  judged  by 
the  promise  they  have  for  helping  to  attain  stated  regional  objectives. 


D.      Program  Evaluation 

The  panel  recommends  that  the  emphasis  in  lab  self  assessment  in  the  next  award  period 
be  on  evaluation  to  improve  program  operations  (formative  evaluation).  Such  evaluation 
should  address  the  questions  "Was  the  program  implemented  as  agreed-upon?"  and  'How 
well  was  it  implemented?" 

If  lab  self-assessment  focuses  on  evaluation  for  self-improvement  in  the  future,  there  will 
be  an  unacceptable  gap  in  OERTs  capacity  to  develop  summative  information  about  the 
impact  of  the  program  for  purposes  of  accountability  and  policymaking.  The  panel 
therefore  recommends  that  OERI  request  the  Congress  to  provide  sufficient  funds  in  the 
future  to  allow  OERI  to  conduct  the  necessary  summative  evaluation. 


E.  Equitable  Distribution  of  Funds 

The  panel  recommends  that  OERI  take  feasible  steps  to  reduce  the  glaring  inequities  in  the 
existing  per-pupil  funding  capacity  of  labs. 

o       OERI  should  request  the  Congress  to  incorporate  present  year-to  year 
appropriations  for  the  lab  rural  initiative  into  continuing  funding  of  the 
program's  institutional  base.  OERI  should  then  make  those  funds  available 
for  all  program  activities  and  re-allocate  them  among  the  l&bs  in  a  way  to 
reduce  the  regional  funding  inequities. 

o       OERI  should  consider  the  possibility  that  any  re-allocation  of  lands  brought 
about  by  the  competition  for  a  lab  in  the  Pacific  Basin  Region  in  1990  may 
provide  a  further,  although  smaller,  way  to  reduce  regional  funding 
inequities. 

F.  Outside  Funding  of  Laboratories 

The  panel  recognizes  that  labs  have  a  legal  right  to  seek  outside  funds;  nevertheless,  it 
recommends  that  OERI  review  such  activities  as  necessary  to  ensure  that  the  labs'  ability  to 
conduct  work  pursuant  to  thuir  core  regional  mission  is  not  jeopardized. 
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The  panel  further  recommends  that  OERI  ensure  that  its  funds  are  not  used  by  labs  to 
subsidize  costs  of  writing  proposals  for  outside  funding  or  otherwise  positioning  themselves 
to  receive  outside  funding. 

G.      Procurement  Mechanism  for  New  Awards 

The  panel  recommends  that  the  Department  of  Education  ask  the  Congress  to  consider 
establishing  a  new  form  of  procurement  instrument  that  would  be  better  suited  to  the  lab 
program  (and  possibly  other  programs  as  well)  than  the  existing  ones.  Such  an  instrument 
should  both  protect  the  legal  rights  of  the  labs  and  the  Government  and  still  allow  the  labs 
a  reasonable  degree  of  flexibility  in  planning  and  implementing  their  programs  over  the  5 
year  period  of  the  new  awards. 

Should  such  a  new  instrument  not  be  available,  the  panel  would  recommend  the  use  of 
contracts,  among  the  existing  alternatives. 

The  panel  also  considered  a  mix  of  grants  and  contracts  in  the  recompetition.  For 
example,  contracts  could  be  used  to  procure  labs'  institutional  functions  and  grants  could  be 
used  to  assist  their  regional  services.  However,  the  panel  recognizes  that  the  logistical 
problems  that  would  be  presented  by  running  concurrent  competitions  may  be 
insurmountable. 

In  any  event,  the  panel  is  concerned  that  the  Department  of  Education  is  not  taking 
maximum  advantage  of  the  existing  discretionary  powers  to  facilitate  contract  administration 
that  are  vested  in  its  lab  staff  as  Contracting  Officers'  Technical  Representatives  (COTR's). 
The  panel  therefore  recommends  that  OERI  explore  with  Ae  Department's  contracts  office 
ways  in  which  administration  of  lab  contracts  could  be  made  more  efficient  and  less 
burdensome  through  greater  exercise  of  the  COTR's  powers. 


H.      Means  to  Facilitate  Competition 

The  panel  recommends  that  OERI  take  every  feasible  step  to  stimulate  actual  competition 
in  the  forthcoming  recompetition. 

o       OERI  should  make  publicly  available  the  various  papers  and  studies  it  has 
commissioned  to  help  its  recompetition  planning.  These  include  policy 
papers,  findings  from  contracted  studies,  records  of  advice  from  any  other 
sources  it  has  solicited,  minutes  of  the  panel's  meeting  with  lab 
representatives  in  February  1989,  the  panel's  1987  report  on  the  external 
review  of  individual  labs  and  this  report. 

o       Notice  of  the  availability  of  these  materials  should  be  made  as  promptly  as 
possible. 

o       OERI  should  allow  at  least  3  months  for  response  to  the  solicitation  in  order 
to  facilitate  preparation  of  high  quality  proposals  from  many  soures. 
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OERI  should  structure  the  solicitation,  particularly  the  proposal  evaluation 
criteria,  to  accommodate  the  legitimate  needs  of  nonincumbents;  for  example, 
by  giving  due  credit  for  excellence  of  plans  and  staffing  and  not  over- 
weighting existing  organizational  capacity. 

OERI  should  not  require  non-incumbent  applicants  to  gain  commitments  to 
serve  on  lab  governing  boards  from  chief  State  school  officers  and  similar 
regional  officials  as  a  condition  of  their  applications.  Reasonable  plans  for 
obtaining  such  commitments  after  the  award  if  a  nonincumbent  is  funded 
should  be  acceptable. 


APPENDIX  B 

LIST  OF  POLICY  PAPERS  COMMISSIONED  BY  OERI 
FOR  RECOMPETITION  PLANNING 


OERI  has  commissioned  severa)  policy  papers  designed  to  provide  different  perspectives  on 
the  lab  program  and  laboratory  functions  in  general  to  help  planning  for  the  recompetition. 

A  listing  of  the  authors  of  the  papers  and  their  topics  follow.  All  but  the  papers  by 
Thomas  Good  and  William  Dunn  were  made  available  to  the  panel  for  its  February  23-24 
meeting.  The  other  two  papers  are  being  made  available  to  the  panel  subsequendy. 

o       Brenda  Turnbull,  Policy  Studies  Associates,  Inc.,  "A  Comparison  of  Service  Modes 
in  ED*s  (the  Department  of  Education's)  Technical  Assistance  Programs 

o       David  Hornbeck,  Johns  Hopkins  Univer  ?  y  and  formerly  chief  State  school  officer 
in  Maryland,  "The  Perspectives  of  a  Former  Chief  State  School  Officer" 

o       Thomas  Good,  University  of  Missouri,  Columbia,  "Classroom  and  School  Research: 
Investments  in  Enhancing  Schools" 

o       Florctta  McKenzie,  The  McKenarie  Group,  Washington,  D.C.  and  formerly 

Superintendent  of  Schools  in  the  District  of  Columbia,  "The  Future  of  Regional 
Educational  Laboratories  in  Contributing  to  Urban  School  Improvement" 

o       James  Guthrie,  University  of  California,  Berkeley,  "Regional  Educational 
Laboratories:  History  and  Prospect" 

o       Neville  Postlethwaite,  University  of  Hamburg,  (The  Federal  Republic  of  Germany), 
"School  and  Classroom  Improvement  in  Two  European  Countries" 

o       William  Dunn,  University  of  Pittsburgh,  "Perspectives  on  Regional  Laboratories  from 
Knowledge  Transfer  in  Non-Educational  Fields" 
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APPENDIX  C 

ILLUSTRATIVE  STATEMENTS  OF  LAB  PROGRAM  MISSION 


The  panel  has  recommended  that  the  mission  statement  for  labs  be  structured  into  two 
parts.  The  first  part  would  be  a  general  statement  of  what  labs  should  do  at  the  program 
level.  The  second  part  would  be  of  statements  of  clear  and  measurable  objectives  by  labs 
for  their  individual  regions. 

Illustrative  statements  of  the  first,  general  mission  statement  at  the  program  level  follow. 

The  mission  of  laboratories  is  to  help  education  practitioners  and  policymakers  apply 
research-based  knowledge  for  purposes  of  school  improvement. 


-or- 


The  mission  of  educational  laboratories  is  to  gain  applications  of  research-based 
knowledge  for  improvement  of  educational  practice  and  policy. 
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LABORATORY  POLICY  PAPER 


CLASSROOM  AND  SCHOOL  RESEARCH:     INVESTMENTS  IN 
ENHANCING  SCHOOLS 


Thomas  Good 

Professor,  Department  of  Curriculum  and  Instruction  and 
Research  Associate,  Center  for  Research  in  Social  Behavior 

University  of  Missouri 
Columbia,  Missouri 


April  1989 


This  is  one  of  several  papers  about  the  regional  laboratory 
program,  or  functions  which  laboratories  perform,  which  the 
Office  of  Educational  Improvement  (OERI)  in  the  U.S. 
Department  of  Education  has  commissioned.    The  purpose  of 
the  papers  is  to  assist  planning  for  the  1990  recompetitlon 
of  awards  to  operate  regional  laboratories.     This  paper  has 
been  written  under  contract  to  the  U.S.  Department  of 
Education.    No  endorsement  by  OERI  or  the  Department  of 
Education  should  be  inferred. 
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Classroom  and  School  Research:    Investments  in  Enhancing  Schools 


Thomas  L .  Good  * ? 


University  of  Missouri  -  Columbia 


1  I  acknowledge  the  support  provided  by  the  Center  for  Research  in  Social 
Behavior  at  the  University  of  Missouri -Columbia  and  especially  thank 
Teresa  H^el lining  and  LeeAnn  Oebo  for  typing  the  manuscript  and  Gail  Hinkel 
for  editing  1t.   Also,  I  want  to  thank  Bruce  Blddle,  Jere  Brophy,  Mary 
Rohrkemper,  Susan  Rosenholtz,  and  Sam  Strlngfield  for  their  valuable 
suggestions  about  the  manuscript. 

4  This  paper  has  been  prepared  at  the  request  of  OERI;  however,  the  views 
expressed  here  are  those  of  the  author,  and  no  endorsement  by  OERI  should 
oe  inferred. 
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Introduction 

I  was  *sked  to  discuss  two  topics  in  this  paper:  (1)  the  adequacy  of 
research  for  informing  practice,  and  (2)  areas  of  research  that  will 
extend  our  knowledge  base  about  schooling.   The  first  topic  also  includes 
the  extent  to  which  existing  knowledge  has  been  disseminated.    The  second 
topic  involves  the  identification  of  research  topics  that  OERI  and  other 
interested  agencies  could  fund  so  that  knowledge  that  can  inform  school 
improvement  programs  will  be  enhanced  by  the  year  2000.   Since  I  and 
everyone  I  have  consulted  within  the  field      concur  that  the  extant 
knowledge  base  for  understanding  schools  and  classrooms  is  inadequate,  I 
will  focus  on  areas  that  merit  subsequent  research  and  development. 

Concerning  the  adequacy  of  research  for  informing  practice,  I  argue 
that  there  is  comparatively  little  research  knowledge  because 
historically  (a)  innovation  has  preceded  research,  (b)  the  social  value 
attributed  to  educational  research  has  been  low,  and  (c)  little 
programmatic  research  has  been  conducted.    Despite  these  problems,  recent 
research  has  yielded  important  knowledge  that  is  of  value  to  educators. 
However,  this  research  has  only  begun  to  address  the  basic  questions  that 
must  be  answered  if  we  are  to  understand  student  learning  in  school 
settings.    In  discussing  the  ability  of  research  to  inform  practice,  I 
summarize  both  classroom  and  school  research,  although  I  emphasize  the 
need  to  integrate  these  two  areas. 

In  addressing  the  issue  of  topics  that  merit  new  funding,  I  intend  to 
create  a  research  "/ision"  without  being  overly  specific  about  research 
questions  and  research  designs.    It  is  clear  to  me  that  the  field 
currently  needs  a  broad  and  rich  infusion  of  basic  research  that  is 
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reasonably  comprehensive.   Needed  is  knowledge  about  a  set  of  core  issues 
if  we  are  to  make  progress  in  understanding  school  learning.    It  is  most 
important  to  support  research  that  promises  sustained  programmatic  inquiry 
about  salient  classroom  issues.    The  research  that  I  advocate  calls  for 
integrative  work  on  curriculum  as  well  as  on  teacher  and  student 
variables.    I  emphasize  that  researchers  cannot  study  teacher  behavior 
independently  of  knowledge  of  teaching  thinking,  student  behavior  and 
thinking,  or  curriculum  variables.    Before  discussing  the  adequacy  of  the 
knowledge  base  I  briefly  introduce  the  new  areas  of  research.   Then  I 
discuss  the  present  knowledge  base  and  issues  (attitudinal  and  funding) 
that  need  to  be  improved  if  new  research  is  to  be  productive.    Following  a 
review  of  the  extant  knowledge  base,  I  present  the  research  agenda  that  I 
believe  should  be  supported.    Finally,  I  briefly  discuss  the  role  of 
regional  laboratories  in  view  of  extant  and  pending  research. 
Research  Base 

Although  knowledge  about  educational  practice  is  relatively  meager 
and  much  ot  it  is  misused,  I  do  want  to  emphasize  that  past  educational 
funding  has  resulted  in  a  knowledge  base  that  has  both  theoretical  and 
practical  significance.   The  minor  investments  in  educational  researrh 
have  already  provided  potentially  powerful  dividends  (depending  on  how 
knowledge  is  used),  and  I  am  confident  that  continued  funding  will  lead  to 
richer  conceptualizations  of  schooling.    This  knowledge  can  be  of  use  to 
state  and  local  educators  who  spend  the  time  necessary  to  understand  both 
the  knowledge  and  its  limitations  and  who  apply  it  to  local  contexts.  By 
analogy,  the  developers  of  the  most  powerful  miracle  drugs  currently 
available  agree  that  those  medicines  will  (a)  be  refined  by  new  research, 
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and  (b)  offer  simple  cures  neither  for  the  common  cold  nor  cancer. 
Considering  the  comparatively  low  funding  of  educational  research  (in 
contrast  to  medical  research),  it  should  come  as  no  surprise  that 
knowledge  about  schooling  is  fragmentary  and  uneven;  however,  in  contrast 
to  their  attitudes  towards  research  in  medicine  (and  in  other 
disciplines),  many  politicians  want  to  continue  to  limit  (or  eliminate) 
funding  for  educational  research  because  it  does  not  yield  definitive 
answers. 

Before  discussing  the  research  areas  that  will  yield  important 
knowledge,  I  want  to  briefly  place  the  call  for  more  research  in  a  larger 
policy  framework  that  examines  both  the  structure  and  level  of  research 
funding.    I  argue  that  research  funding  in  this  country  is  both  inadequate 
and  deteriorating.    Further,  although  I  am  "bullish"  on   research,  we  need 
to  delineate  carefully  what  research  can  and  cannot  do.   One  of  the  past 
difficulties  in  obtaining  support  for  research  has  been  educators' 
creation  of  inordinately  high  public  expectations  and  the  failure  to 
fulfill  those  expectations. 

Simply  to  remain  even  with  funds  that  were  spent  in  1973  on  basic 
research  and  development  in  education,  the  federal  government  would  need 
to  increase  its  investment  in  educational  research  by  600%.    Such  an 
increase  (and  much  more)  could  be  spent  wisely  to  expand  our  knowledge  of 
classrooms  and  schools  in  ways  that  would  enhance  students'  mastery  of 
basic  curriculum  concepts,  capacity  for  critical  thinking,  and  ability  to 
use  knowledge  to  address  societal  problems.    I  have  emphasized  areas  of 
research  and  development  that  seem  to  be  a  logical  extension  of  past 
investments  of  NIE  and  now  OERI.    I  do  npl  argue  that  these  are  the  only 


or  the  best  investments  to  make,  but  rather  that  they  expand  programs  of 
research  supported  by  the  federal  government  in  the  past.    These  areas  are 
summarized  in  the  next  section  and  discussed  in  more  detail  later  in  the 
paper. 

Areas  of  Research  That  Merit  Funding 

New  research  needs  to  focus  on  the  curriculum  so  that  we  can  better 
conceptualize  important  subject-matter  variables  and  develop  tasks  that 
require  students  to  integrate  knowledge.    New  conceptualization  and 
research  are  needed  if  we  are  to  move  the  curriculum  from  a  "coverage" 
perspective  to  one  that  stresses  understanding.    In  particular,  it  is 
necessary  to  include  in  the  curriculum  sore  activities  that  encourage 
students  to  think  and  reflect  so  that  there  is  a  balance  between  higher- 
order  and  lower-order  thinking. 

New  work  must  address  how  students  react  to  instruction  and 
curriculum  assignments.    Considerable  evidence  suggests  that  many  students 
have  learned  to  be  passive  in  classrooms,  and  this  must  change  if  students 
are  to  take  some  responsibility  for  their  own  learning. 

Another  research  area  that  must  be  continued  --  but  with  a  new  focus 
involves  teachers'  thinking  and  its  relation  to  their  classroom 
behavior.    Researchers  need  to  build  conceptual  bridges  between  teachers' 
views  of  curriculum  and  students,  and  teachers'  classroom  decisions  and 
performance.   There  are  numerous  studies  of  teachers'  thinking  and 
behavior;  research  that  examines  both  student  and  teacher  behavior  and 
thought  simultaneously  is  needed. 

New  research  should  study  schools  as  institutions  and  how  resources 
1n  schools  can  be  allocated  in  ways  that  encourage  students,  teachers,  and 
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administrators  to  engage  in  intelligent,  productive  behavior.    There  is 
growing  evidence  that  productive  behavior  may  vary  according  to  the  school 
or  classroom  context.    For  example,  the  structure  and  climate  in  some 
schools  encourage  critical  thinking  and  the  sharing  of  useful  ideas  among 
teachers.   Unfortunately,  other  school  environments  promote  less  adaptive 
behavior.   More  information  is  needed  about  how  both  desirable  and 
undesirable  norms  and  institutional  practices  develop  and  are  sustained. 
Finally,  if  students  are  to  be  more  active  learners,  schools  should 
encourage  teachers  to  be  more  active  (e.g.,  model  appropriate  learning 
processes)  but  at  the  same  time  assist  students  to  assume  increasingly 
more  control  of  their  own  learning. 

Although  research  on  these  topics  will  extend  knowledge  of  schooling, 
it  will  not  yield  a  comprehensive  understanding  of  schooling  because  so 
many  other  topics  need  to  be  studied.   Although  I  do  not  discuss  these 
: -^cs  in  detail  later  in  the  pages,  I  summarize  several  of  them  below. 

Teacher  recruitment  and  retention  are  key  issues  for  the  1990s.  The 
number  of  talented  individuals  who  enter  teaching  is  not  as  large  as  it 
once  was.    Because  the  conditions  of  teaching  are  not  as  attractive  as 
they  once  were,  the  most  talented  teachers  leave  the  field  earlier  than 
others.   The  recruitment  and  retention  of  minority  teachers  are  of  special 
concern.   The  United  States  faces  an  immense  problem  of  establishing  more 
educational  and  professional  opportunities  for  minorities.   This  problem 
begs  for  fresh  conceptualization,  creative  problem  solving,  and  progress. 
Eubanks  (1988)  notes  that  data  clearly  show  an  impending  shortage  of 
minority  teachers  in  47  of  50  states.    He  notes  that  the  higher  the 
education  level,  the  fewer  the  number  of  minorities  enrolled.   One  could 
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reasonably  argue  that  without  better  adult  role  models,  there  is  less 
Incentive  for  minority  students  to  fulfill  their  potential  in  public 
schools.   However,  this  issue  must  be  broadly  addressed  and 
conceptualized. 

We  need  to  learn  why  talented  teachers  leave  teaching  and  chen  we 
must  develop  models  for  ir,  .     ing  the  conditions  under  which  teachers 
work.    Stringfield  (perscnal  communication)  argues  that  in  exploring  these 
questions  researchers  should  use  longitudinal  studies  of  why  people  go 
into  teaching  and  why  they  stay,  because  cross-sectional  data  do  not 
provide  particularly  compelling  o.  useful  information.    Why  do  only  one- 
half  of  the  persons  who  receive  bachelor's  degrees  in  education  teach  even 
one  year?   What  are  the  other  half  doing?   Who  is  surviving  the  first 
year?   Why  do  they  survive?   After  five  years  of  teaching  are  teachers 
satisfied  with  the  basic  ro'ie  of  teaching  and  have  they  continued  to  grow 
as  professionals  or   a'/e  they  developed  routine  ways  of  rc-ponding  to 
classroom  issues? 

Educators  must  also  learn  how  to  use  computers  to  improve  classroom 
learning.    Despite  the  computer's  potential,  we  still  have  little 
knowledge  about  how  it  is  used  and  whether  it  improves  students'  capacity 
for  thinking  and  problem  solving.   Some  disturbing  data  suggest  that 
minority  and  low-income  students'  access  to  computers  is  more  limited  than 
students  of  higher  socioeconomic  status.   This  is  a  problem  that  must  be 
explored.    If  inequities  exist,  they  must  be  corrected. 

Lepper  and  Jurtener  (1989)  note  that  several  advantages  of  using 
computers  in  schools  have  been  challenged.   Advocates  believe  that  the 
computer  can  make  learning  tore  int  insically  motivating,  lead  to  a 


school  curriculum  that  emphasizes  more  cooperation  and  collaboration,  or 
increase  equality  of  educational  opportunity  (i.e.,  it  is  fair  and  does 
not  judge  learning  today  narrowly  in  terms  of  what  a  learner  did 
yesterday).    However,  others  argue  that  because  computers  are  more  readily 
available  in  some  schools  than  others,  they  extend  or  at  least  sustain 
inequalities  in  educational  opportunity. 

According  to  Lepper  and  Jurtener,  the  outcomes  of  computer  usage  are 
also  related  to  the  number  of  computers  available  in  a  school.    In  some 
classrooms,  all  students  have  access  to  a  computer;  in  other  classrooms 
there  may  be  only  three  computers  for  30  students.    Some  schools  may  have 
only  three  computers.    In  addition,  how  students  use  computers  is  also 
important.   Unfortunately,  as  Lepper  and  Jurtener  point  out,  good 
empirical  research  is  sorely  lacking.    They  call  for  more  theoretically- 
based  research  that  focuses  on  the  underlying  processes  in  which  students 
are  engaged,  in  particular  the  direction  and  intensity  of  the  students' 
attention  as  they  use  computers.   Becker  (1986)  offers  useful  advice  about 
research  that  document  the  effects  of  computer  utilization  on  student 
learning. 

There  is  increasing  evidence  that  the  language  and  the  ways  students 
approach  educational  tasks  are  influenced  by  interaction  in  students' 
hWSl  (see  Rohrkemper,  in  press).   Some  of  the  "unalterable"  variation 
associated  with  schooling  may  therefore  be  alterable  by  making  changes  in 
the  home  or  with  joint  home  and  school  action..   Obviously,  both  parents 
and  schools  have  limitations  in  this  area,  but  by  combining  home  and 
school  resources  it  may  be  possible  to  increase  students'  expectations  and 
performance  significantly.   Unfortunately,  research  indicates  that  these 
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relationships  are  most  problematic  between  schools  and  low-income  families 
(Brantlinger,  1985,  1987).   We  must  alter  the  situation  in  which  the 
economically  deprived  either  perceive  or  receive  less  from  the  schools 
than  do  other  families. 

Educators  have  much  to  learn  from  comparative  education,  the  study  of 
educational  systems  in  other  countries,  which  offers  many  opportunities 
for  reconsidering,  and  perhaps  changing,  some  educational  practices  that 
we  take  for  granted.    For  example,  Japan  provides  teachers  20  in-service 
days  per  year.   Are  some  of  the  coherence  and  attention  to  understanding 
that  characterize  the  Japanese  curriculum  related  to  teachers'  use  of  this 
time  to  consider  educational  practice?  As  various  educators  have 
indicated  (e.g.,  Romberg,  1988)  the  U.S.  is  the  only  first-world  country 
in  which  teaching  is  a  9-month  job.    Perhaps  by  extending  the  school  year 
by  a  few  weeks  and  paying  teachers  adequately  for  the  additional  time, 
their  productivity  and  job  satisfaction  might  be  enhanced.    In  some 
countries  the  literacy  rates  exceed  our  own  (e.g.,  Th<:  Netherlands),  and 
in  other  countries  (e.g.,  Japan)  students'  mathematical  performance 
greatly  surpasses  that  of  U.S.  students.    By  studying  how  these  countries 
develop  curricula  we  might  better  understand  both  the  strengths  and  the 
weaknesses  of  our  own  educational  approaches.    For  tco  long  funding 
agencies  have  viewed  investments  in  comparative  research  as  nonessential. 
However,  if  educators  want  understand  some  of  the  best  exemplars  of 
educational  practice,  researchers  need  to  study  practices  in  other 
countries.    Because  complex  and  subtle  societal  factors  as  well  as 
schooling  practices  may  differentiate  countries  (e.g.,  Holloway,  1988), 
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successful  comparative  research  will  involve  competent  bilingual  observers 
and  interviews.    Such  research  is  not  inexpensive. 

Finally,  knowledge  about  how  research  is  used  is  limited  and  is  an 
area  that  deserves  research.    Bruce  Biddle  (1989)  contends  that  the  extent 
to  which  policymakers  use  social  research  is  an  enigma.    Some  believe  that 
social  research  produces  knowledge  that  improves  public  policy.  Many 
other  scholars,  however,  hold  that  this  research  has  little  effect  on 
policy  decisions  ?nd  that  it  produces  knowledge  that  is  not  disseminated, 
is  ignored,  or  is  blatantly  misused  by  policymakers.    If  research  is 
utilized,  it  is  important  to  learn  the  role  that  it  plays.    Do  research 
findings  and  concepts  help  to  define  "problems,"  or  do  policymakers  view 
educational  research  only  as  part  of  the  "solution"?   Are  administrators 
familiar  with  research  conducted  in  the  last  20  years?   Are  they  willing 
to  read  original  reports  or  to  have  staffers  read  them,  or  are  they 
content  to  read  second-  and  third-hand  accounts  of  research? 

Adequacy  of  Research  for  Informing  Practice 
Having  summarized  topics  that  require  additional  research,  I  now 
consider  the  role  of  research  in  forming  school  policy.    I  discuss  past 
constraints  on  the  development  of  a  knowledge  for  base  for  understanding 
classrooms  because  the  failure  to  recognize  structural  weaknesses  may 
cause  new  research  to  be  relatively  ineffective.  Historically, 
educational  innovation  nas  preceded  research,  in  part  because  educators 
are  expected  to  produce  immediate  solutions  to  problems.    Further,  funding 
for  educational  research  has  always  been  too  limited,  making  it  difficult 
for  groups  of  investigators  to  systematically  explore  critical  issues. 
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Reform  and  Simplistic  Conceptions  of  Teaching 

As  Good  (1983)  and  Good  and  Biddle  (1988)  argue,  most  educational 
reform  movements  in  the  United  States  have  concerned  single  variables  or 
clusters  of  variables  focused  on  only  one  problem  of  schooling  and  have 
not  been  based  on  research.    The  general  assumption  appears  to  be  that 
there  is  a  common  problem;  therefore,  tl.ere  ought  to  be  a  simple  solution. 
At  various  times,  educators  in  this  century  have  advocated  as  answers 
large-group  Instruction,  sm«ll-group  teaching,  and  Individualized 
teaching  (Good  &  Biddle,  1988)!    Similarly,  both  direct  instruction  and 
discovery  learning  have  been  cited  at  different  times  as  means  for 
Improving  education.    Unfortunately,  this  logic  defies  experience  as  well 
as  results  of  research.    The  problems  of  U.S.  schooling  vary  from  school 
to  school  (Good  &  Brophy,  1986;  Good  &  Weinstein,  1986),  and  research  has 
s.iown  that  even  teachers  at  the  same  grade  level  in  the  same  school  may 
have  different  problems.    Thus,  if  some  classrooms  have  too  much  structure 
and  other  classrooms  have  too  little -structure,  then  a  simple  call  for 
more  time-on-task  will  produce  uneven  effects. 

Simple  characteristics  of  instruction  have  never  predicted  student 
achievement,  although  many  reform  efforts  have  focused  on  such 
characteristics  (Good,  1983).    The  important  issue  is  not  whether 
Individualized  instruction,  small-group  Instruction,  or  discovery  learning 
1s  emphasized  but  rather  the  oualitv  and  the  fit  of  planning  and 
Instruction  to  each  child's  and  community's  needs.   Moreover,  defining 
Instructional  quality  requires  observation  of  classroom  teaching. 

In  the  past  few  educational  researchers  observed  teaching  (Dtmkin  & 
Biddle,  1974),  although  It  seems  advantageous  to  conduct  observational 


ERIC  5^ 


11 

research  before  curriculum  reform  is  undertaken  so  that  data  can  be 
integrated  into  the  design  and  the  testing  of  alternative  solutions  to 
educational  problems.    Observational  research  should  also  be  conducted 
after  reforms  are  implemented  to  establish  the  effects  of  reforms  (Good  4 
Biddle,  1988).    Unfortunately,  until  recently,  when  educational  research 
began  to  include  observational  measures,  research  usually  followed  rather 
than  preceded  educational  innovations.    Too  often  reform  has  also 
proceeded  without  meaningful  involvement  of  teachers,  that  is,  the  impetus 
for  change  came  from  external  sources. 
Inadequate  Funding  for  Research 

A  major  reason  that  there  was  so  little  observational  research  was 
the  inadequate  funding  for  educational  research.  Conducting 
observational  research  is  labor-intensive  and  hence  expensive.  Complex 
coding  systems  need  to  be  developed,  coders  must  be  recruited  and 
trained,  and  analyzing  classroom  data  requires  professional  expertise. 
Unfortunately,  the  low  priority  assigned  to  educational  research  has 
resulted  in  the  allocation  of  too  few  funds  to  allow  systematic, 
sophisticated  research  and  development.    The  federal  government  has  been 
--  and  continues  to  be  --  unwilling  to  pay  for  educational  research  (Finn, 
1988;  Shavelson  &  Berliner,  1988). 

Compared  to  funds  for  research  in  business  and  defense,  the  money 
assigned  to  educational  budgets  reflects  little  political  support  for 
educational  research.    From  my  perspective,  this  means  that  educational 
research  is  seriously  underfunded.    The  development  and  implementation  of 
high-qual  ty,  innovative  educational  ideas  are  severely  limited. 
According  to  Futrell  (1986),    the  federal  government  includes  S61  billion 
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for  research  and  development  in  its  fiscal  1987  budget.    Of  these  funds, 
.2%  is   allocated  for  educational  research.    In  comparison,  61.2%  will  go 
for  military  research,  9.3%  for  health  studies,  8.1%  for  energy  research, 
and  6.6%  to  NASA.   As  Bruce  Biddle  and  I  note  elsewhere  (Good  &  Biddle, 
1988),  the  Office  of  Research  in  the  U.S.  Department  of  Education,  which 
is  responsible  for  federal  research,  presently  has  a  research  budget  of 
roughly  $47  million.   Of  these  funds,  only  $500,000  are  now  said  to  be 
available  to  support  new  lines  of  inquiry.   The  paucity  of  funding  is  seen 
perhaps  more  clearly  when  one  considers  that  the  present  "fly-away"  cost 
of  a  single  B-l  bomber  is  $212.5  million  (Good  &  Biddle,  1988). 
Furthermore,  a  new  B-2  bomber  costs  about  $S15  million. 

Other  scholars  also  lament  the  inadequate  funding  for  educational 
research.   According  to  Shavelson  and  Berliner  (1988),  "As  the  nation 
began  to  worry  about  an  AIDS  epidemic,  $252  million  was  allocated  for 
research.    In  fact,  we  see  6.2  billion  federal  dollars  spent  each  year  for 
medical  research  in  general.    When  a  national  need  was  sensed  recently, 
the  government  quickly  responded  by  investing  $8  million  for 
superconductivity  research.    Yet  when  this  administration  discovered  a 
national  crisis  in  education  based  on  dozens  of  reports  that  documented 
serious  problems  with  the  nation's  schools,  the  funding  for  educational 
research  decreased!   While  15%  of  the  federal  dollars  that  go  to  defense 
are  used  to  support  research,  only  0.1%  of  the  federal  dollars  spent  on 
educational  programs  are  used  to  support  research  (p.  11)."   Many  believe 
that  developing  a  body  of  technical  knowledge  about  education  and  teaching 
is  not  important.   Although  society  views  investments  in  medical  knowledge 
as  necessary,  there  is  virtually  no  interest  in  educational  research. 
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Despite  the  unwillingness  of  American  educators  to  spend  money  for 
research  and  development,  an  examination  of  the  annual  reports  of  most 
American  businesses  reflects  a  pride  in  investing  in  research.  For 
sample,  in  the  1988  annual  repcrt  of  the  Eli  Lilly  and  Company 
(Excellence  in  the  Life  Sciences)  the  company  announces  plans  for  a  new 
$110  million  research  center  and  that  it  had  otherwise  increased  its 
research  and  development  budget  jy  16%  --  over  the  previous  year  --to  $541 
million.    Similarly,  Pfizer's  1988  annual  report  (Building  Shareholder 
VllUg  Through  Innovation)  indicated  that  the  company  had  increased  its 
research  and  development  expenses  in  1988  by  18%  -  to  $473  million. 
Further,  the  company  announced  an  increase  in  its  research  investment  in 
1989  by  a  similar  amount  (i.e.,  18%). 

This  lack  of  willingness  to  invest  in  educational  research  has 
important  consequences.    For  example,  Slavin  (1987,  1989)  contends  that 
it  is  extremely  unfortunate  that  after  21  years  of  Title  I/Chapter  I 
(more  than  45  billion  dollars),  there  has  been  little  careful  research  on 
the  effective  uses  of  Chapter  I  funds.   Thus,  we  know  little  about  what 
takes  place  in  those  programs  and  whether  or  not  they  are  effective.    As  a 
result,  we  do  not  know  how  to  address  the  needs  of  students  at  risk  of 
school  failure. 

The  public  continues  to  be  willing  to  spend  money  on  education,  and, 
according  to  Colvin  (1989),  educational  spending  has  increased 
substantially  since  1983  -  nearly  25%  in  real  terms.  However, 
distressing  evidence  continues  to  mount  that  the  federal  government  is 
unwilling  to  fund  systematic  research  that  might  provide  a  basis  for  the 
wise  spending  of  new  funds  to  improve  schooling. 


This  unwillingness  to  invest  in  educational  research  is  evidenced  in 
several  ways.    For  example,  consider  the  decline  of  the  budget  of  the 
federal  office  charged  with  promoting  and  coordinating  educational 
research.    In  1973,  the  newly-created  National  Institute  of  Education  had 
a  budget  of  "135.8  million  dollars.    The  congressional  funds  that  were 
authorized  amounted  to  103.1  million,  and  an  additional  32.7  million 
dollars  were  transferred  to  NIE  from  other  federal  educational  budgets. 
Of  that  135.8  million,  the  following  allocations  were  made  in  1973: 
research  and  development  centers,  19.1;  regional  laboratories,  22.5;  ERIC, 
3.9;  other,  79.2;  and  field-initiated  research,  11.0.    In  contrast,  the 
OERI  research  budget  for  1989  shows  a  dramatic  decrease.    In  the  present 
budget  year,    47.1  million  dollars  are  allocated  for  the  research  function 
of  OERI.    Of  these  dollars,  17.8  million  are  allocated  to  research  and. 
development  centers,  22.1  million  to  labs,  5.7  million  to  ERIC,  500,000 
for  field-initiated  research,  and  the  rest  were  spent  on  "other."   When  we 
control  for  inflation,  it  is  clear  that  the  budget  of  OERI  would  have  to 
be  increased  by  roughly  600T.  to  match  the  available  funds  for  research  and 
development  activities  that  were  offered  to  it  in  1973  (see  Statistical 
Abstract  of  the  United  jtafo?  for  relevant  information  about  rate  of 
inflation).    The  need  for  systematic  research  on  educational  issues  has 
not  declined.    Policymakers  appear  to  have  been  willing  to  spend  45.1 
billion  dollars  on  identifiable  programs  without  a  clear  commitment  to 
research  and  development  that  could  indicate  whether  the  programs  are 
useful.    Others  have  also  concluded  that  reduced  funding  has  lowered  the 
quality  of  information  about  education  (see  recent  report  from  the  United 
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States  General  Accounting  Office  entitled  Education  Information.  November, 
1987) . 

Beliefs  about  the  low  value  of  research  knowledge  in  education 
restrict  teachers'  professional  activities.    Knowledge  production,  at 
least  in  public  schools,  is  not  expected.    Further,  faculty  in  colleges  of 
education  are  rarely  rewarded  primarily  for  research  and  scholarship. 

Society  is  ambivalent  towards  educators.   The  public  consistently 
professes  that  schools  are  keys  to  society's  economic  and  social  security. 
However,  they  seldom  support  educational  funding  designed  to  study 
carefully  long-term  strategies  for  improving  schooling.    The  public's 
demand  for  accountability,  coupled  with  inadequate  long-term  funding  for 
research  and  development,  pressure  many  educators  to  promise  that  they 
will  do  more  in  the  short  run  than  they  can  conceivably  accomplish.  They 
tend  to  be  overly  optimistic  about  research  and  new  educational  products 
(e.g.,  new  curricula).    Educators  and  researchers  are  reluctant  to 
acknowledge  that  no  educational  program  is  ideal  for  all  students  because 
schooling  is  a  multifaceted  process  that  is  affected  by  many  VdHables  (as 
1s  the  case  in  many  research  areas  ...  see  Thomas,  1980,  for  an  eloquent 
discussion  of  what  is  unknown  in  medicine).    Perhaps  because  of  this 
pressure  educators  are  prone  to  move  from  fad  to  fad  in  search  of  new 
solutions  (see  Good  &  Biddle,  1988).    However,  exaggerated  optimism  about 
short-term  accomplishments  inevitably  leads  to  a  mismatch  between  what  is 
expected  and  what  is  actually  accomplished  and  to  a  further  erosion  of 
public  confidence  in  the  ability  of  educational  research  to  play  a  useful 
role.   Attractive  but  overly  ambitious  plans  may  be  a  good  tactic  for 
securing  short-term  funds  for  program  improvements,  but  this  strategy 
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eventually  leads  to  anxiety  about  the  original  investment,  disenchantment 
with  results,  and  a  growing  unwillingness  to  provide  long-term  funding  for 
educational  research  and  development.    It  is  time  to  recognize  that 
complicated  problems  that  tosk  years  to  create  may  require  a  decade  (or 
decades)  or  educational  research  and  development.    For  example,  it  seems 
unreasonable  to  expect  educators  to  transform  learning  environments  in 
inner  cities      even  when  they  have  new  resources  with  which  to  respond  to 
the  problem      when  there  is  an  inadequate  knowledge  base  about  learning 
conditions  in  those  settings.    If  we  are  to  improve  public  schools,  we 
must  recognize  the  need  to  conduct  long-term  basic  research.  This 
responsibility  falls  to  individual  researchers  as  well  as  to  institutions 
that  conduct  research  and  development. 

In  addition?  policymakers  need  to  better  recognize  the  conditions 
under  which  educational  research  will  be  successful.    In  this  sense,  those 
who  advocate  research  can  prepare  policy  documents  that  encourage 
researchers  to  submit  proposals  for  long-term  funding  of  research  that 
builds  on  basic  knowledge  in  the  field  rather  than  studies  that  promise 
unrealistic  responses  to  complex  problems  quickly  and  inexpensively. 
Increased  Interest  in  Observational  Research 

Although  funding  for  educational  research  remains  low,  during  the 
past  15-20  years  there  has  been  a  growing  recognition  of  the  importance  of 
research  that  examines  classroom  processes.    Researchers  from  a  variety  of 
disciplines,  using  different  methodologies  (i.e.,  both  quantitative  and 
qualitative)  have  made  observational  research  a  valued  activity.  Even 
though  this  type  of  research  is  expensive,  its  growing  importance  has  led 
researchers  to  move  from  surveys  to  actual  examination  of  classroom 
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practice.  However,  even  today,  classroom  observation  continues  to  be  the 
exception  rather  than  the  rule  (it  is  simply  less  of  an  exception  than  it 
used  to  be!). 

Among  the  numerous  factors  that  led  to  increased  observational 
research  in  the  1970s,  two  are  of  major  importance.    First,  research 
syntheses  published  in  the  mid-1970s  (e.g.,  Dunkin  &  Biddle,  1974) 
signified  the  need  for  observational  data  collected  in  particular  contexts 
as  a  prerequisite  for  describing  and  understanding  instructional  effects. 
Another  major  factor  was  the  increased  involvement  and  interest  of  federal 
agencies,  particularly  the  Office  of  Education's  funding  of  evaluation 
studies  such  as  Project  Follow-Through  and  the  National  Institute  of 
Education's  funding  of  several  large-sc.  e  field  studies  that  involved 
classroom  observation  (for  more  discussion  on  the  development  of  the 
field,  see  Brophy  &  Good,  1986). 

The  opportunity  to  collect  observational  data  led  to  an  explosion  of 
interest  1n  variation  among  classrooms  in  U.S.  schools.   Many  had 
criticized  schools  1n  the  1960s  and  contended  that  the  variation  in 
Instruction  between  and  within  schools  was  minor.    Preliminary  results, 
however,  Indicated  that  there  might  be  more  variation  than  previously 
anticipated;  hence,  many  researchers  began  to  observe  classrooms. 

Although  the  movement  of  research  into  classrooms  may  seem  but  a 
small  step,  technical  knowledge  is  necessary  to  describe  teaching  and 
classrooms.   Unfortunately,  as  late  as  1975  there  was  little  systematic 
knowledge  about  classrooms  as  social  organizations  and  learning 
environments. 
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Knowledge  from  Recent.  R?<Parrh 

The  field  has  made  good  progress  in  the  past  two  decades  (for  reviews 
see  Brophy  &  Good,  1986;  Good  &  Brophy,  1987;  Shulman,  1986).    As  Brophy 
(1988)  notes,  two  decades  ago  when  teachers  raised  questions  about 
classroom  management,  they  were  offered  vague  and  often  conflicting  advice 
from  research.   That  advice  typically  was  not  based  on  systematic  research 
in  classrooms.   There  were  only  scattered  results  that  did  not  form 
interpretable  patterns.    However,  research  on  classroom  organization  and 
management  in  the  past  20  years  has  produced  consistent  and  useful 
knowledge  that  offers  general  principles  and  knowledge  that  teachers  can 
use  in  developing  classroom  environments  in  which  students  are 
appropriately  involved.   Today,  the  field  possesses  replicated 
correlational  findings  and  process  relationships  that  have  been  validated 
in  field  experiments  (see  Gage  &  Needles,  1989).   The  development  of  a 
technical  culture  and  associated  specialized  knowledge  is  evident  not  only 
in  the  area  of  classroom  management  but  in  many  other  areas  as  well  (e.g., 
students'  knowledge  and  conceptual  change,  teachers'  planning). 

Qqantnv  of  Instruction.    It  is  beyond  the  purpose  of  this  paper  to 
review  this  literature  in  any  detail  (interested  readers  can  see  Brophy  & 
Good,  1986).    However,  it  seems  appropriate  to  summarize  some  of  the  major 
results  of  this  research.    The  most  consistently  reported  findings  concern 
the  quantity  of  academic  instruction  that  teachers  provide.    Many  studies 
have  demonstrated  that  amount  learned  is  determined  in  part  by  opportunity 
to  learn  (exposure  to  relevant  content),  which  is  determined  by  four  broad 
teacher  behaviors.   First,  the  extent  to  which  teachers  are  businesslike 
and  task-oriented,  emphasize  instruction  as  basic  to  their  role,  expect 


ERIC 


6/ 


19 

students  to  master  the  curriculum,  and  allocate  most  classroom  time  to 
those  activities  that  have  relevant  academic  objectives  is  important. 
Second,  teachers  whose  students  make  reasonable  academic  progress 
frequently  use  classroom  organization  and  management  strategies  that 
maximize  the  time  students  spend  engaged  in  academic  activities.  Third, 
effective  teachers  allow  students  to  move  through  the  curriculum  briskly 
but  also  relatively  successfully.    Fourth,  these  teachers  were  found  to 
spend  most  of  their  time  actively  instructing  their  students  in  group 
lessons  or  supervising  their  work  on  assignments  rather  than  allowing 
students  to  spend  inordinate  time  on  individual  seatwork  practice  without 
supervision  or  feedback. 

Quality  of  instruction.    There  are  also  findings  about  the  quality  of 
instruction.    In  particular,  student  achievement  is  enhanced  when 
teachers'  presentations  and/or  demonstrations  include  sufficient 
enthusiasm,  clarity,  logical  sequencing  of  content,  and  structuring  of  the 
content  1n  ways  that  help  students  to  recognize  it  as  an  integrated  whole. 
Thus,  through  using  advance  organizers,  outlining,  and  calling  attention 
to  main  Ideas,  teachers  help  students  to  see  and  appreciate  the 
relationships  among  parts  of  a  lesson  and/or  how  concepts  might  be 
Interrelated  (for  greater  elaboration  see  Good  &  Brophy,  1987;  Slavin, 
1989).    Much  contemporary  work  is  focused  on  the  quality  of  teachers' 
subject-matter  knowledge  and  pedagogical  content  knowledge  (e.g.,  Shulman, 
1987). 

The  technical  culture  now  extends  well  beyond  the  process  measures 
associated  with  students'  performance  and  the  traditional  content 
measures.    Contemporary  work  is  enhancing  knowledge  of  how  students  make 
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progress  in  problem  solving  and  develop  higher-order  thinking  skills 
(Porter  &  Brophy,  1988).    Subject-matter  knowledge  --  and  how  to  structure 
classrooms  to  enhance  advanced  subject-matter  learning  --is  getting 
increased  attention  (Richardson-Koehler,  1987). 

A  comparison  of  the  knowledge  of  schooling  2  decades  ago  with 
contemporary  knowledge  shows  that  extraordinary  progress  has  been  made  in 
understanding  classroom  instruction  and  learning.    For  example,  2  decades 
ago  there  was  no  literature  on  the  communication  of  expectations  in 
classrooms.    In  the  ensuing  20  years  considerable  progress  has  been  made 
in  conceptualizing  and  understanding  how  teachers  might  communicate 
differential  performance  expectations  to  students  under  the  complex 
constraints  of  classroom  teaching  (e.g.,  Good  &  Brophy,  1987).  Twenty 
years  ago  there  was  nfl  systematic  information  available  about  classroom 
management.    In  the  literature  of  the  late  1960s  there  was  no  emphasis  on 
proactive  management,  a  concept  th«t  Kounin  introduced  in  1970.  Comparing 
the  literature  on  classroom  management  in  1958  with  Doyle's  (1986) 
integrative  review,  one  can  readily  ascertain  the  important  progress  that 
has  occurred  <n  terms  of  the  level  of  concepts  and  findings  that  are 
pre  sitly  available  in  this  area.    Two  decades  ago  there  was  only 
fledgling  work  in  cognitive  science,  with  an  emphasis  on  classroom 
application.    Enormous  strides  have  been  maae  in  this  area  (e.g.,  Resnick, 
1983).   Numerous  other  examples  could  be  cited  to  vividly  illustrate  how 
much  more  is  known  about  classroom  teaching  presently  than  was  the  case  2 
decade'  ago  (see  for  example  Brophy,  in  press;  Pearson,  1934;  Richardsor 
Koehler,  1987;  Slavin,  1989;  Wittrock,  1986).   Modern  research  focuses  not 
only  on  interaction  in  the  classroom  (which  dominated  the  work  of  the 
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1970s  and  early  1980s)  but  also  examines  the  presentation  of  subject 
matter,  the  core  issue  around  which  much  classroom  interaction  occurs.  It 
is  evident  that  new  advances  are  occurring  in  basic  curriculum  areas  such 
as  mathematics,  reading,  writing,  and  science,  and  that  students  are  now 
characterized  as  active  learners  in  a  complex  social  setting  (see  for 
example  Anderson  &  Smith,  1987;  Confrey,  1987;  Corno  &  Rohrkemper,  1985; 
Florio-Ruane  &  Dunn,  1987;  Mergendoller  &  Marchman,  1987;  Raphael,  1987; 
Wittrock,  1SS6). 

Recent  Advances  in  Research  on  Teaching 

Various  sources  document  recent  improvements  in  research  on  teaching 
(Brophy,  1989;  Brophy  &  Good,  1986;  Clark  &  Peterson,  1986;  Slavin, 
1989).   As  previously  noted,  research  in  the  1970s  provided  a  foundation 
linking  classroom  processes  to  student, achievement.    This  research  made  it 
undeniably  clear  that  teachers  make  a  difference  in  students'  learning 
and  yielded  several  instructional  models  (e.g.,  active  teaching, 
communication  of  expectations,  etc.)  that  identified  some  of  the  ways  in 
which  teacher  behavior  influences  student  achievement  (Good  &  Brophy, 
1987). 

However,  several  characteristics  of  this  research  limit  its 
application.    Perhaps  the  major  problem  wa   that  these  studies  initially 
intended  to  establish  that  teachers  affected  student  learning,  not  to 
explain  theoretically  iiow  teachers  had  an  effect.    This  research  yielded 
information  about  effective  teaching,  but  only  concarning  certain,  fairly 
general,  teacher  behaviors.    The  data  base  is  therpfore  probably 
sufficient  for  making  gross  distinctions  among  teachers  --  for  identifying 
teachers  who  do  not  have  the  necessary  minimum  skills  for  organizing  and 
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implementing  instruction,  but  it  cannot  distinguish  average  teaching  from 
truly  outstanding  teaching. 

More  comprehensive.    Several  changes  have  occurred  in  the  field  in 
the  attempt  to  study  qualitative  aspects  of  teaching  more  thoroughly. 
Brophy  (1989)  notes  that  in  the  1980s  classroom  researchers  focused  more 
on  particular  curriculum  units,  sometimes  even  on  individual  lessons  (or 
concepts),  and  on  teachers'  instructional  objectives  (their  beliefs  and 
Intentions)  in  addition  to  their  instructional  behavior.    Indeed,  the 
shift  in  focus  in  some  cases  was  so  drastic  that  researchers  substituted 
one  set  of  design  problems  for  another.    That  is,  researchers  explored 
more  comprehensively  the  mental  lives  of  teachers  but  ignored  how  teachers 
implemented  lessons.    In  addition,  there  was  a  growing  insistence  among 
researchers  that  students*  learning  be  considered  in  terms  of  problem 
solving  and  higher-order  thinking  as  well  as  the  mastery  of  basic  facts. 
Rather  than  measuring  student  performance  only  on  criterion -referenced  or 
standardized  achievement  tests,  researchers  interviewed  students  to  assess 
their  ability  to  explain  key  constructs  in  their  own  language  and  to  apply 
that  information.    Studies  also  examined  students'  views,  or  attitudes, 
about  learning. 

Active  student  learner?.    Recent  research  also  examines  active 
student  learning  as  well  as  active  teaching  (e.g.,  Swing  &  Peterson, 
1988).    Studies  conducted  in  the  1970s  established  that  active  teaching, 
for  example,  clear  expectations  and  modelling  of  problem  solving, 
facilitated  student  learning.    Research  in  the  1980s  shows  that  students 
need  opportunities  to  ask  questions  about  relevant  content,  think 
critically,  and  apply  information.    Thus,  much  recent  research  attempts  to 
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explain  how  the  social  settings  of  classrooms  affect  students' 
understanding  of  subject  matter. 

As  Brophy  notes,  many  current  researchers  support  a  theory  of 
learning  that  has  been  influenced  by  the  information-processing  approach 
to  human  cognition.    This  approach  emphasizes  the  important  student 
learning  goals  that  teachers  must  accomplish  as  well  as  teachers'  ability 
to  communicate  knowledge  actively  and  clearly.    Moreover,  information 
processing  holds  that  teachers  must  be  concerned  with  students'  current 
knowledge  and  with  the  information  processing  and  conceptual  change 
required  to  enable  students  to  reach  learning  goals.    Teachers  should 
allow  students  progressively  more  opportunity  for  integrating  and 
controlling  their  own  learning. 

Unfortunately,  little  classroom  research  has  focused  on  how 
assignments  should  be  designed  and  implemented  to  encourage  independent 
learr/ing.    Morr        irch  needs  to  examine  students'  motivation  to  learn 
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and  their  willingness  to  notice  and  to  attempt  to  clarify  differences 
between  their  c.-rent  knowledge  and  new  information.    Indeed,  there  is 
some  evidence  that  many  students  are  not  actively  engaged  in  acquiring  new 
information;  they  passively  attempt  to  understand  what  the  teacher  wants 
and  then  memorize  facts  (see  for  example  Good  et  al.,  1987;  Goodlad, 
1984) . 

Teachers'  subject-matter  and  pedagogical  mntent  knnwipHqa  Perhaps 
the  most  dominant  focus  in  current  research  is  the  distinction  between 
teachers'  subject-matter  knowledge  and  pedagogical  content  knowledge. 
Subject-matter  knowledge  involves  teachers'  understanding  of  a  particular 
subject  (e.g.,  biology),  whereas  pedagogical  content  knowledge  concerns 
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teachers'  ability  to  identify  from  the  knowledge  they  possess  about  a 
subject  those  ideas  that  are  important  to  teach  to  students  at  a 
particular  grade  level.    This  includes  communicating  or  structuring 
learning  activities  so  that  students  can  understand  and  interrelate  key 
ideas.    Much  important  research  is  examining  what  subject-matter  knowledge 
and  pedagogical  content  knowledge  teachers  need  to  enhance  student 
learning  (see  for  example  Brophy,  in  press;  Carpenter  et  al.,  1988; 
Peterson,  Fennema,  Carpenter,  &  Loef,  1989). 

Teachers'  subject-matter  and  pedagogical  content  knowledge  are  likely 
to  have  important  consequences  for  student  learning.    Some  teachers  are 
relatively  ineffective  because  their  subject-matter  knowledge  is  low. 
Moreover,  teachers  may  be  relatively  high  in  some  subject-natter  knowledge 
but  relatively  lew  in  other  knowledge  (language  arts  vs.  mathematics). 
However,  what  distinguishes  new  research  is  its  focus  on  the  extent  to 
which  teachers  use.  knowledge  (i.e.,  transform  subject-matter  knowledge 
into  pedagogical  content  knowledge).   According  to  Brophy  (1989,  p. 5): 
"Where  their  knowledge  is  more  explicit,  better  connected,  and  more 
integrated,  they  will  tend  to  teach  the  subject  more  dynamically, 
represent  it  in  more  varied  ways,  and  encourage  and  respond  fully  to 
student  comments  and  questions.    Where  their  knowledge  is  limited,  they 
would  tend  to  depend  on  the  text  for  content,  deemphasize  interactive 
discourse  in  favor  of  seatwork  assignments,  and  in  general  portray  the 
subject  as  a  collection  of  static  factual  knowledge."    Some  studies 
suggest  that  teachers  are  more  flexible  when  teaching  a  subject  that  they 
are  highly  knowledgeable  about  than  when  presenting  content  about  which 
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they  are  less  knowledgeable  (e.g.,  Duffy  &  Roehler,  1989).  However,  much 
more  empirical  work  needs  to  be  done  in  this  area. 

To  summarize,  some  exciting  concepts  and  theories  about  teaching  that 
facilitates  students'  conceptual  understanding  are  beginning  to  emerge. 
For  example,  many  classroom  researche *s  argue  that  teaching  for 
understanding  involves  not  only  asking  students  to  supply  relevant  facts 
(a  traditional  focus)  but  also  structuring  learning  activities  so  that 
students  must  offer  explanations  and  defend  their  thinking.    There  is  a 
growing  belief  that  students  must  engage  topics  more  meaningfully,  use 
their  own  language  to  describe  concepts,  and  apply  subject-matter 
knowledge  to  problem-solving  situations.    However,  some  teachers  who  can 
achieve  these  student  goals  may  still  be  hampered  because  they  do  not  have 
a  well -developed  understanding  of  domain-specific  knowledge  about  many  of 
the  topics  they  teach.    They  may  recognize  that  they  need  to  explain 
certain  topics  or  integrate  certain  concepts,  but  they  may  need  additional 
subject-matter  knowledge  before  they  can  do  so.   Other  teachers  may  have 
excellent  subject-matter  knowledge  but  lack  the  disposition  or  the 
pedagogical  content  knowledge  necessary  to  teach  it  meaningfully. 

Teachers'  belief  systems.    It  is  ironic  that  contemporary  and 
comprehensive  studies  of  pedagogical  content  knowledge,  which  involve 
careful  examination  of  various  teacher  beliefs  about  instruction,  indicate 
that  many  other  teacher  beliefs  control  how  teachers  use  their  subject- 
matter  knowledge.   Teachers'  beliefs  about  equal  opportunities  for 
students  to  respond,  their  expectations  for  students'  general  performance, 
and  their  views  of  how  students  learn  may  be  as  important  --  and  in  some 
cases  more  important  --  than  their  simple  pedagogical  content  knowledge. 
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Researchers  must  integrate  pedagogical  content  knowledge  with  other  forms 
of  pedagogical  knowledgs,  including  teachers'  beliefs  about  teaching  as  a 
profession,  how  students  learn,  and  the  goals  that  are  perceived  to  be 
important  in  a  particular  school,  in  order  to  understand  how  teachers 
influence  students'  learning. 
Use  and  Misuse  of  Classroom  Research 

Unfortunately,  many  practitioners  and  especially  policymakers  believe 
that  recent  classroom  research  suggests  that  competent  teachers  only  need 
good  communication  skills.    Unfortunately,  policymakers  use  limited 
knowledge  from  the  technical  culture  in  a  controlling,  rule-governing, 
bureaucratic  fashion.    I  believe  that  technical  knowledge  needs  to  be 
adjusted  to  particular  settings  use  controlled  by  teachers'  professional 
discretion  and  decision  making.   As  Catherine  Mulryan  and  I  argue  (Good  & 
Mulryan,  in  press),  successful  teaching  involves  more  than  effective 
communication  (appropriate  pace,  clarity,  good  use  of  examples).    It  also 
entails  the  application  of  principles  of  cognitive  development  (e.g., 
preoperational  students  need  numerous  concrete  examples,  formal 
operational  students  can  work  with  abstractions),  understanding  of  human 
motivation,  knowledge  of  subject  matter,  as  well  as  pedagogical  skills 
necessary  to  help  students  to  understand  the  curriculum.   Although  recent 
research  is  valuable,  it  yields  only  limited  information  about  the  full 
range  of  knowledge,  dispositions,  and  skills  that  teachers  need  if  they 
are  to  be  successful  in  the  classroom  across  several  student  outcomes 
(Brophy,  1988). 
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School  Research 

There  1s  now  considerable  research  showing  that  the  school  students 
attend  can  make  a  substantial  difference  in  their  education  (Brookover  et 
al.,  1979;  Edmonds,  1983;  Good  &  Brophy,  1986;  Good  &  Weinstein,  1986; 
Purkey  &  Smith,  1983;  Rosenholtz,  1985;  Rutter,  1983;  Wimpleberg,  Teddlie, 
&  Strlngfield,  1989).    It  is  beyond  the  purpose  of  this  paper  to  review 
this  literature  1n  detail;  however,  it  is  appropriate  to  consider  briefly 
some  of  the  broad  findings  from  this  research. 

Sacral  findings.    Edmonds  (1983)  contends  that  the  characteristics 
of  effective  schools  are  (a)  a  pervasive  and  broadly  understood 
Instructional  focus;  (b)  an  orderly,  safe  climate  conducive  both  to 
teaching  and  learning;  (c)  leadership  of  the  principal  reflected  by 
continuing  attention  to  the  quality  of  instruction;  (d)  teacher  behaviors 
that  convey  an  expectation  that  all  students  are  to  achieve  at  least 
minimum  mastery;  (e)  the  use  of  measures  of  pupil  achievement  as  the  basis 
for  program  evaluation.    In  general,  most  of  the  early  research  on  school 
effectiveness  centered  on  general  characteristics  believed  to  distinguish 
more  productive  from  less  productive  schools,  with  school  outcomes  being 
measured  1n  relatively  narrow  ways.    However,  some  of  the  school 
effectiveness  research  suggested  that  the  "parts"  somehow  "came  together" 
1n  effective  schools.    For  example,  Rutter  (1983)  report:;  that  the 
correlation  between  the  combined  measure  of  overall  school  process  and 
each  of  the  outcome  measures  (attendance,  achievement,  student  conduct) 
was  much  stronger  than  was  the  correlation  between  any  single  process 
variable  and  outcome  measure.    This  empirical  finding  implies  that  various 
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social  factors  may  combine  to  create  a  school  ethos,  or  a  set  of  values 
and  behaviors  that  characterizes  a  school. 

New  data.   Unfortunately,  because  of  the  paucity  of  research  funding, 
there  has  been  relatively  little  new,  basic  research  on  effective 
schooling  in  the  past  few  years.    However,  some  new  and,  I  believe,  useful 
research  provides  data  and  subtle  caveats  about  the  important  role  of 
context  in  defining  effective  schools,  even  when  definitions  of  "desirable 
outcomes"  are  held  constant  (e.g.,  Hal  linger  &  Murphy,  1986;  Mortimore, 
Sammons,  Stoll,  Lewis,  &  Ecob,  1988;  Teddlie  &  Stringfield,  1985).    It  is 
beyond  the  purpose  of  this  paper  to  review  this  evidence;  however,  recent 
work  provides  clear  evidence  that  what  constitutes  an  effective  school 
depends  on  school  context  (see  also  Teddlie,  Stringfield,  Wimpleberg,  & 
Kirby,  1989).    In  addition  to  new  context  data,  there  is  also  information 
about  qualitative  aspects  of  classroom  organization  and  teaching  that 
appear  important  if  effective  learning  is  to  occur. 

Evidence  on  school  effectiveness  continues  to  grow.    Mortimore  et 
al.  (1988)  studied  2,000  pupils  as  they  moved  through  4  years  of 
classroom  life  (from  ages  7  to  11).   They  collected  data  in  50  jurior 
schools  randomly  selected  from  the  636  inner-London  schools.  Numerous 
factors  were  found  to  differentiate  effective  schools  from  schools  that 
had  fewer  effects  on  student  achievement.    Here  I  will  comment  on  only 
three  of  those  factors      structured  lessons,  intellectually  challenging 
teaching,  and  maximum  communication  between  teachers  and  students. 

Results  indicated  that  the  best  classroom  teachers  exhibited  a 
reasonable  degree  of  structure  but  provided  some  freedom  for  pupils  within 
a  well-defined  framework.    Effective  teachers  had  some  organizational 
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flexibility  in  beginning  and  ending  lessons  were  able  to  vary  lesson 
activity,  to  some  extent,  in  order  to  maintain  student  motivation.  This 
finding  suggests  that  teachers  must  learn  to  use  different  instructional 
models  rather  than  depending  too  much  on  a  single  model.  Obviously, 
teachers  who  continue  with  one  format  too  long  will  find  it  difficult  to 
maintain  the  maximum  motivation  for  all  students. 

In  etrective  classrooms  teachers  more  often  used  higher-order 
questions  and  statements  and  they  encouraged  students  to  engage  in  problem 
solving.    Teachers  were  willing  to  challenge  students'  preconceptions  and 
required  them  to  think  about  content.    Furthermore,  teachers  in  effective 
schools  created  an  interesting  context  for  learning  by  expressing  their 
own  interest  and  enthusiasm  and  explaining  the  purpose  and  the  value  of 
subject  matter. 

The  data  Indicate  that  pupils  gained  from  having  many  opportunities 
to  communicate  with  teachers.    Some  teachers  spent  most  of  their  time 
speaking  to  Individual  students;  in  these  classes  each  student  could  only 
have  limited  contact  with  the  teacher.    In  contrast,  other  teachers 
communicated  with  entire  classes.    The  researchers  do  not  arguo  that 
teaching  should  be  whole-class;  rather,  they  support  a  flexible  approach. 
They  note  some  teachers  had  individualized  classes  to  such  an  extent  that 
there  were  little  important  communication  among  teacher  and  students.  In 
such  classes  teachers  seldom  modeled  a  process  (or  had  students  model)  or 
structured  issues  before  assigning  students  to  work  individually  or  in 
groups.   Effective  teachers  had  at  their  disposal  a  repertoire  of 
Instructional  approaches  that  allowed  them  to  communicate  effectively  with 
the  whole-class,  with  small  groups  of  students,  and  with  individual 
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students.   They  could  present  higher-order  information  to  students  in  a 
stimulating  way. 

Again,  these  data  suggest  how  easy  it  is  to  confuse  the  form  of 
instruction  and  its  quality.    Many  reform  advocates  inappropriately 
conclude  that  because  much  instruction  that  is  boring  and  focuses  on  low- 
level  skills  occurs  in  a  whole-class  format,  a  change  to  another 
organizational  format  will  solve  the  problem.   Mortimore  et  al.'s  data 
suggest,  however,  that  hja*  a  format  is  used  is  the  critical  issue. 

School  Context-    Like  many  other  "effective  schools"  researchers, 
Hallinger  and  Murphy  (1986)  note  some  striking  similarities  betwst,, 
effective  h1gh-and-low-SES  schools:    for  example,  a  clear  mission, 
Instructional  leadership,  a  safe  and  orderly  environment,  high 
expectations,  and  a  well -coordinated  curriculum.    However,  they  found 
important  differences  in  effectiveness  as  a  function  of  school  setting. 
For  example,  the  alignment  of  the  curriculum  with  instruction  1n  low-SES 
schools  was  moderate  but  1n  high-SES  schools  it  was  very  close.  In 
contrast,  principals'  control  of  instruction  in  low-SES  schools  was  high 
but  1n  h1gh-SES  schools  1t  was  low  to  moderate. 

Hallinger  and  Murphy  argue  that  effective  schools  take  the  learning 
abilities  and  needs  of  their  students  into  account  when  they  develop 
curriculum.    They  note  the  high-SES  schools  had  greater  pressure  to 
instruct  in  all  areas  in  which  students  were  tested,  and  thus  there  was 
close  alignment  between  instruction  and  testing.    Interestingly,  in  one 
low-SES  school,  teachers  pointed  out  that  during  the  previous  year 
students  had  scored  poorly  on  one  mathematics  topic  but  the  teachers 
decided  not  to  direct  instruction  to  that  area  so  that  they  could  maintain 
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high  achievement  in  other  areas.   Thus,  some  implications  from,  school- 
effectiveness  research  (e.g.,  teach  all  areas  covered  on  a  test  equally) 
may  not  be  applicable  in  some  contexts,  for  example,  where  students  need 
time  to  understand  rather  than  to  cover  more  content. 

In  terms  of  control  of  instruction,  principals  in  effective  low-SE.S 
schools  maintained  relatively  tight  control,  directly  selecting  and 
implementing  curriculum  and  instructional  programs.   Although  principals 
in  effective  high-SES  schools  frequently  visited  classrooms  and 
coordinated  school-wide  curricula,  these  principals  controlled  classroom 
instruction  less  and  generally  allowed  teaches  to  make  decisions  about 
how  to  achieve  agreed-upon  student  goals. 

Teddlie,  Stringfield,  Wimpleberg,  and  Kirby  (1987)  also  report 
various  differences  between  effective  low-SES  and  effective  middle-SES 
schools.    For  example,  teachers  in  effective  middle-SES  schools  contacted 
parents  more  frequently  and  believed  that  parents  were  highly  concerned 
about  the  quality  of  their  children's  education.    However,  teachers  and 
principals  in  effective  low-SES  schools  did  not  perceive  parents  to  be 
involved  with  the  education  of  their  children  and  initiated  relatively 
little  contact  with  parents. 

It  is  beyond  the  purpose  of  this  paper  to  discuss  context 
comprehensively.   However,  there  is  growing  evidence  that  variables  that 
seem  important  in  one  setting  are  not  critical  in  other  settings.  Brophy 
&  Evertson  (1976)  illustrated  some  time  ago  that  appropriate  in<tr-  „tion 
varies  in  classrooms  serving  different  types  of  students.    Recent  research 
has  extended  this  qualification  to  variation  in  school  context. 
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Wimpleberg,  Teddlie,  and  Stringfield  (1989)  argue  that  context  can 
Include  socio-political  variables  such  as  "...the  socioeconomic  background 
of  the  students,  governance  structures  that  determine  fiscal  and 
operational  decision  making,  grade  levels  (age  of  students  and  curriculum 
program  of  the  school,  and  more"  p.  82).    In  the  1990s  I  believe  that 
context  will  be  defined  in  more  dynamic  ways.    For  example,  two  schools 
might  be  populated  by  students  from  a  low-socioeconomic  background,  but 
one  school  may  be  located  in  a  district  that  contains  a  core  of  college- 
educated  individuals  who  have  moved  back  into  an  urban  area  and  in  the 
other  district  no  such  resources  may  be  available.    In  another  school  area 
there  may  be  a  grass  roots  movement  of  citizens  who,  although  not  college 
educated,  have  high  expectations  for  what  schools  can  accomplish  and  can 
provide  considerable  resources  for  schools.    In  some  schools  responsive 
staffs  are  ready  to  work  with  concerns  of  committed  parents;  in  other 
schools  the  teaching  faculty  may  be  part  of  the  problem.    Perhaps  one  of 
the  core  issues  for  researchers  in  the  1990s  will  be  to  integrate  the  need 
to  produce  general izable  concepts  and  useful  analytical  frameworks  with 
the  fact  that  each  classroom  is  unique  (Rohrkemper,  personal 
communication). 

It  1s  easy  to  trivialize  context  and  to  interpret  it  too  narrowly  in 
terms  of  grade,  student  SES,  or  other  classificatory  variable*.    It  is 
clear  that  beliefs  and  perceptions  that  teachers  and  learners  bring  to  the 
classroom,  the  assignments  students  receive,  and  the  language  they  use  at 
home  (and  on  the  playground)  are  all  important  aspects  of  context  that 
must  be  considered  in  estimating  the  general izability  of  empirical 
findings.   Although  recent  classroom  and  school  research  have  further 
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sensitized  educators  to  this  context,  one  pressing  issue  is  the  need  to 
conceptualize  more  powerful  ways  for  describing  learning  contexts.  The 
ultimate  goal  is  to  achieve  the  match  between  the  individual  learner  and 
the  curriculum  that  will  lead  to  the  most  productive  and  mindful  learning. 
Although  we  have  made  some  important  progress  in  studying  context,  our 
ability  to  describe  the  needs  of  individual  learners  in  particular 
settings  is  very  limited.    The  caveat  here  is  that  even  if  one  matches  the 
context  of  the  research  report  (e.g.,  low-SES  classrooms)  with  the 
appropriate  practical  setting  (e.g.,  low-SES  classrooms)  it  is  important 
to  acknowledge  and  to  accept  the  limitation  that  research  that  focuses  on 
"average  students"  may  make  egregious  errors  when  trying  to  specify  the 
learning  needs  of  individual  students. 

As  Doyle  (in  press)  argues,  understanding  how  meaning  is  created  in  a 
classroom  context  requires  a  sophisticated  and  well -developed  language  for 
describing  teachers'  and  students'  interpretations  0f  classroom  events  as 
well  as  &2D±l  per  se.    In  the  1980s  researchers  have  made  considerable 
progress  in  describing  classroom  events  (behavior,  tasks);  in  the  1990s  we 
must  further  analyze  participants'  perceptions  of  schooling.  Descriptions 
of  both  dimensions  are  necessary  if  we  are  to  understand  classroom 
contexts;  clearly,  classrooms  can  and  do  differ  on  both  dimensions.  For 
example,  study  of  how  teachers  communicate  expectations  is  important; 
however,  the  extent  to  which  students  perceive  expectations  1s  equally 
important. 

Ihfiflry.   One  of  the  emerging  emphases  in  the  effective  schools 
literature  is  a  focus  on  theory.    For  example,  work  by  Rosenholtz  (1989) 
provides  clear  evidence  that  the  normative  culture  varies  in  more  and  less 
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effective  schools,    in  a  real  sense,  Rosenhonz's  work  brings  inco  the 
"context"  discussion  the  beliefs  and  dispositions  of  teachers.    She  found 
that  teachers  in  effective  schools  had  shared  goals  about  what  was 
important  and  had  the  chance  to  collaborate  with  other  teachers  and  to 
continue  their  own  learning.    In  effective  schools,  teachers  saw  that 
working  with  others  reduced  their  uncertainty  about  school  practices  and 
increased  their  classroom  success.    Rosenholtz  nc<.ed  that  teachers' 
certainty  about  a  technical  culture  and  their  own  instructional  practice 
was  an  important  construct.   As  teachers  developed  greater  certainty  about 
instruction  and  further  developed  their  technical  knowledge,  they  seemed 
willing  to  search  for  reasons  and  ways  to  help  students  rather  than 
looking  for  excuses  for  failure.    She  notes  that  teaching  was  always 
difficult  and  that  there  were  many  uncertainties  and  problematic  aspects 
associated  with  it. 

Rosenholtz  found  that  some  schools  tended  to  conceptualize  teaching 
as  routine  and  other  schools  viewed  it  as  nonroutine.    In  schools  that 
looked  at  teaching  as  routine,  teachers  tended  to  work  alone,  with  only 
their  own  observations  and  habits  on  which  to  base  reflection  and  growth. 
In  schools  that  saw  teaching  as  more  nonroutine,  there  were  more  attempts 
to  gain  and  share  technical  knowledge  about  instruction. 

According  to  Rosenroltz,  r.. .ambiguous  goals,  unclear,  infrequent 
evaluation,  and  a  lack  of  common  purpose  lead  to  greater  instructional 
uncertainty  and,  at  the  same  time,  grant  teachers  wide  latitude  to  define 
ind  independently  pursue  their  own  goals.    In  other  words,  goal 
multiformity  encourages  norms  of  self-reliance  ana,  as  a  consequence, 
professions!  isoV.ion  from  colleagues.   The  absence  of  professional 
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Interaction,  of  substantive  dialogue  about  their  work,  carries  profound 
implications:    Individuals  may  come  to  perceive  that  comparatively  few 
colleagues  suffer  similar  uncertainties  about  teaching,  that  they  endure 
fewer  instructional  problems;  and  that  if  others  experience  few  problems, 
there  is  embarrassment  in  admitting  one's  own.    Thus,  to  protect  their 
self-esteem  in  isolated  settings,  colleagues  neither  ask  for  nor  expect 
any  heip,  and  cannot  be  imposed  upon  by  others.    In  collaborative 
settings,  on  the  contrary,  teaching  is  defined  as  an  inherently  difficult 
undertaking;  one  that  challenges  the  best  of  teacher-.   And  if  even  the 
most  capable  teachers  need  help  in  similar  situations,  there  is  little 
reason  to  question  one's  own  sense  of  professional  worth.  Stated 
differently,  the  less  ego-endangering  teachers'  workplace  circumstances, 
the  more  they  will  request  and  offer  advice  and  assistance  to  accomplish 
agreed  upon  goals"  (p.  C). 

Psychic  rewards  played  an  important  role  in  teachers'  certainty  about 
instruction.    If  principals,  colleagues,  students,  and  parents  gave 
teachers  positive  feedback  about  their  work,  their  uncertainty  diminished. 

Rosenholtz  argues  that  teacher  commitment  was  present  in  many  schools 
to  the  extent  that  they  had  shared  goals,  learning  opportunities  for 
teachers  as  well  as  students,  task  autonomy,  and  psychic  rewards  from 
their  work.    Teachers  in  less  effective  schools  were  more  interested  in 
freedom  fnoj;  they  thought  little  of  freedom        In  my  opinion,  the  most 
important  result  of  Rosenholtz's  study  is  a  coherent,  integrative  analysis 
of  how  the  social  organization  of  schools  influences  perceptions  and 
behav.;r  of  school  staff  in  ways  that  either  enhance  or  reduce  the  quality 
of  classroom  teaching. 
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Abuses  of  research.    Rosenholtz  (1989)  notes  that  although  research 
on  successful  school  practices  offers  clear  evidence  that  schools  affect 
student  achievement,  the  potential  of  any  strategy  to  enhance  student 
performance  is  heavily  influenced  by  the  context  in  which  schooling 
occurs.   Thus,  there  is  no  easy  formula  for  school  improvement  --  only 
guidelines  and  concepts  that  educators  can  use  in  planning  improvement 
programs.    Despite  careful  critiques  pointing  out  the  limitations  of 
school  research  (see,  for  example,  Good  &  Brophy,  1986;  Good  &  Weinstein, 
1986),  many  districts  are  attempting  to  apply  the  results  of  school - 
effectiveness  research  in  order  to  improve  s';udent  performance. 
Unfortunately,  many  of  the  prescriptions  and  formulae  for  effective 
schools  are  exceedingly  narrow  and  undermine  rather  than   enhance  teacher 
creativity.   Many  school  reform  plans  appear  to  be  uninformed  by  evidence 
that  the  social  context  of  a  school  is  a  key  factor  in  planning  school 
reform  (e.g.,  Hallinger  &  Murphy,  1986). 
Co^on  Weaknesses      Classroom  and  School  Rgse^rrh 

Now  that  researchers  have  clarified  that  schools  and  teachers  make  a 
difference,  it  is  important  to  explain  more  completely  how  processes  at 
both  levels  operate  and  how  they  can  oe  combined.    Researchers  should  not 
only  examine  school  practices  (e.g.,  school  rules)  or  classroom 
assignments  (e.g.,  the  extent  to  which  instruction  emphasizes  rote 
learning  or  meaningful  learning)  but  should  also  study  how  the  effects  of 
one  teacher  can  be  combined  with  the  effects  of  other  teachers  in  ways 
that  do  not  threaten  teacher  autonomy  yet  make  schooling  more  coordinated 
and  effective  for  al concerned. 
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Another  common  weakness  of  research  at  both  the  school  and  classroom 
levels  is  that  the  relations  examined  involve  student  achievement  as 
measured  by  standardized  achievement  tests.    However,  as  Rhona  Weinstein 
and  I  argue  (Good  &  Weinstein,  1986),  in  addition  to  measuring 
interpretive  knowledge,  schools  need  to  broaden  and  diversify  what  they 
teach  students  in  the  various  content  areas.    For  example,  many  process 
studies  show  that  mathematics  is  taught  as  a  means  of  producing  exact 
answers.   Too  little  time  is  spent  on  mathematical  problem  solving  or  on 
using  mathematics  for  estimation  and  for  dealing  with  uncertainties, 
despite  the  fact  that  much  of  our  society's  application  of  mathematics 
involves  such  activities.   Other  scholars   also  point  to  the  need  for 
schools  to  broaden  their  outcomes  (e.g.,  Goodlad,  1984;  Rosenholtz,  1989). 

There  is  growing  recognition  that?  researchers  need  to  attend  to  both 
school  and  classroom  processes.    Part  of  the  research  agenda  for  the 
future  is  to  examine  processes  that  facilitate  instruction  both  in  the 
classroom  and  in  the  school  at  large.   Some  decisions  concerning  the 
allocation  of  resources  may  improve  both,  but  others  may  lead  to  an 
overemphasis  at  one  level  that  erodes  teacher  autonomy  or  does  not  yield 
coordination  between  school  and  classroom  resources.    Weinstein  and  I 
believe  that  differences  in  teaching  styles  are  not  only  inevitable  but 
often  have  positive  effects  on  students.   Thus,  attempting  to  balance 
school  and  classroom  concerns  is  not  an  argument  for  teachers  in  the  same 
school  to  use  similar  styles  and  practices.    Rosenholtz  (1989)  provides 
data  that  demonstrates  that  individual  teacher  autonomy  and  a  shared 
direction  for  the  school  can  co-occur.    Indeed,  her  data  suggest  that  both 
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dimensions  must  be  present  If  teachers  are  to  feel  Intellectually 
challenged  and  supported  In  their  school  settings. 

The  Idea  of  teachers  exchanging  Ideas  and  Improving  Instruction  Is 
not  based  on  the  notion  that  teachers  will  Imitate  a  particular  teacher 
or  a  program  goal.    Rather,  if  schools  are  to  affect  student  outcomes 
significantly,  teachers  must  be  cognizan*  of  how  other  teachers  In  the 
same  school  teach,  including  teachers  at  other  grade  levels,  and  know  now 
to  use  other  teachers  as  resources  (Good  &  Welnsteln,  1986). 
Teachlno  as  Professional  Activity 

It  1s  beyond  the  scope  of  this  paper  to  review  the  literature  on 
teaching  as  professional  activity.   However,  as  I  have  noted  elsewhere 
(Good,  1989),  there  is  Increasing  evidence  that  many  teachers  are 
dissatisfied  with  the  conditions  in  which  they  work.    For  example,  in  a 
study  conducted  1n  1988  by  the  National  Education  Association,  many 
teachers  reported  dissatisfaction  with  their  involvement  in  decision- 
making.   Ninety-four  percent  of  the  teachers  indicated  that  they  should 
have  some  say  about  other  ceachers  who  are  hired,  88%  indicated  the  need 
for  an  active  voice  1n  standardized  testing  policies  and  procedures,  and 
82%  wanted  more  opportunity  to  discuss  budget  issues.    Given  these  teacher 
beliefs,  there  1s  growing  recognition  of  the  need  to  allow  teachers  more 
opportunity  for  significant  involvement  in  school  management.    If  teaching 
1s  to  be  a  profession,  teachers  need  some  opportunity  to  influence  the 
conditions  of  teaching. 

Freldson  (1984)  contends  that  it  is  not  necessary  to  speak  of 
deprofesslonallzation  as  long  as  the  formulation  and  direction  of 
professional  work  remain  in  the  hands  of  members  of  the  profession. 


ERIC  8/ 


39 

However,  in  certain  professions  in  which  workers  make  the  putative  claim 
to  be  professionals,  this  issue  of  control  is  extremely  problematic. 
Increasingly,  the  control  of  education  is  in  the  hands  of  members  of 
state  boards  of  education  or  state  departments  of  education,  although 
their  formal  connection  to  university  facu  ty  members,  public  school 
teachers,  and  educational  researchers  is  often  remote  at  best.  The 
argument  that  members  of  the  education  profession  are  controlling  the 
direction  of  the  profession  is  therefore  e/tremely  problematic  and  in  many 
cases  erroneous. 

Decisions  about  standards  of  curriculum  and  pupil  performance  are 
increasingly  made  by  individuals  who  have  little  understanding  of  student 
cognition  and  development,  formal  knowledge  of  subject  matter,  and  insight 
into  instructional  process  linking  students  and  subject  matter  in 
integrative  ways  (i.e.,  sophisticated  decisions  about  what  subjects  and 
instructional  methods  are  appropriate  for  particular  students).  Even 
though  our  technical  knowledge  of  teaching  is  expanding  and  it  is  the  case 
that  we  understand  better  the  degree  of  integration  of  knowledge  that 
must  occur  if  teachers  are  to  enact  curriculum  meaningfully  (e.g.,  Doyle, 
in  press).   Teachers1  and  schools'  capacity  for  decision  making  is  being 
diminished  by  external  influences. 

Ironically,  schools'  inability  to  function  professionally  and 
productively  is  at  least  partly  to  blame  for  external  constituencies' 
demands  (and  legislation)  for  reform.    It  was  not  an  arbitrary  public 
that  demanded  that  school  principals  be  trained  in  financial  and 
bureaucratic  ways,  which  left  them  largely  uninformed  of  major  advances 
In  curriculum  and  instruction.   That  is,  principals'  low  level  of  concern 

ERiC  83 


with  critical  issues  of  instruction  and  curriculum  is  due  in  part  to 
decisions  by  many  local  school  boards,  who  value  orderly  and  smooth- 
functioning  schools.    Teachers,  as  a  professional  group,  have  been  remiss 
1n  asserting  the  joint  ownership  of  the  curriculum  with  lay  boards.  All 
too  often,  teachers'  expertise  and  knowledge  of  instruction  has  been 
ignored  in  favor  of  the  opinions  of  lay  boards  and  administrators  who  are 
far  removed  from  advances  in  the  field. 

Thus,  there  seems  to  be  a  lack  of  normative  beliefs  about  the  value 
of  a  technical  culture  and  unwillingness  to  spend  resources  to  advance 
the  technical  culture  (and  challenge  extant  practice)  in  most  school 
districts.    It  is  altogether  fitting  to  assert  that  federal  funds  for 
educational  research  have  been  Inadequate.   However,  it  is  also  important 
to  recognize  that  school  districts  largely  refuse  to  invest  in  research 
and  development  activities  that  have  enormous  potential  to  enhance 
teachers'  technical  knowledge.   The  call  here  is  for  school  districts  to 
Invest  more  1n  small-scale  research  and  development  ...  large-scale 
research  I  would  see  as  a  federal  responsibility. 

Two  other  factors  have  also  limited  educators'  ability  to  be  treated 
professionally.  First  1s  the  fact  that  there  was  essentially  no  knowledge 
base  until  recently,  and  even  now  there  is  a  very  limited  one.  It  is  also 
the  case  that  many  teachers  and  principals  are  ill-informed  about  even  the 
small  knowledge  base  that  exits.  Until  both  groups  have  the  opportunity 
and  begin  to  act  more  as  professionals,  they  are  unlikely  to  be  treated  as 
professionals.  Professionals  or  teachers  who  are  too  busy  to  read  are  not 
professionals. 
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Changing  school  struct.urp.    One  of  the  obvious  reasons  for  jointly 
considering  school  and  classroom  variables  in  research  as  well  as  policy 
is  that  many  changes  that  are  necessary  in  classrooms      especially  those 
designed  to  professionalize  teaching  -  can  only  occur  if  structural 
changes  are  made  in  schools.    For  example,  Romberg  (1988),  contends  that 
for  teaching  to  become  a  profession,  it  will  be  necessary  to  make  it  a 
full-time  job.   He  notes  that  the  United  States  is  the  only  first  world 
country  that  hires  teachers  for  9  to  10  months.    'le  further  notes  that 
class  loads  must  be  reduced  if  teachers  are  to  have  time  to  reflect,  to 
plan,  to  work  with  individual  students,  and  to  collaborate  with  peers. 
According  to  Romberg,  3  hours  a  day  of  instruction  are  more  than 
sufficient,  for  any  professional  teacher.    Furthermore,  master  teachers 
need  not  meet  every  class  every  day  for  every  student  activity.  If  the 
schadule  were  so  organized  and  if  staffing  were  appropriately  done,  master 
teaches  could  offer  direct  instruction  only  2  or  3  days  a  week  and  other 
adults  could  supervise  other  activities.    In  elementary  schools,  meeting 
classes  only  on  certain  days  of  the  week  might  be  disruptive  of  continuity 
for  both  teachers  and  students.    Hence,  at  the  elementary  school  level  it 
might  be  more  viable  to  talk  about  meeting  classes  for  fewer  hours  during 
the  day.    Further,  in  some  school  environments  it  might  make  sense  for 
more  face-to-face  instruction  than  is  presently  the  case.   The  point  is 
not  necessarily  that  "less"  is  better  (e.g.,  in  Japan  teachers  engage  in 
more  face-to-face  instruction)  but  that  we  should  begin  to  match 
■instructional  time  and  staffing  decisions  in  terns  of  the  problems  and 
opportunities  that  are  presented  in  particular  school  contexts. 
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Romberg  argues  that  the  profession  needs  a  career  ladder  so  that 
teachers  can  see  a  professional  future.    It  makes  little  sense  to  give 
teachers  who  have  taught  competently  for  10  years  the  same 
responsibilities  and  resources  that  beginning  teachers  have.   Although  one 
might  not  agree  with  all  of  Romberg's  beliefs  (e.g.,  the  need  for  a  full- 
year  calendar),  he  makes  a  compelling  argument  that  many  of  the  important 
changes  in  classrooms  require  intervention  in  the  schools  as  well.  The 
structure  and  the  social  organization  of  schools  must  be  altered  if 
classroom  teaching  is  to  be  improved  and,  similarly,  classroom  teaching 
-«ust  be  enhanced  if  schools  are  to  be  more  productive  and  stimulating 
academic  environments. 

Teacher  collaboration.   Structurally,  schools  discourage 
collaboration  and  encourage,  at  least  implicitly,  isolation.  Rosenholtz 
(1986)  argues  that  several  factors  can  contribute  to  organizational 
inertia  that  characterizes  most  schools:    the  absence  of  performance 
feedback,  a  lack  of  collegia!  assistance,  and  limited  teacher 
participation  in  the  development  of  instructional  programs.  Rosenholtz 
(1989)  has  shown  that  changes  in  the  social  organization  of  schools  can  be 
associated  with  different  norms  for  peer  assistance  (e.g.,  whether  it  is 
permissible  to  seek  help  or  information  when  one  has  a  problem). 

Bird  and  Warren-Little  (1986)  note  that  few  public  schools  sustain 
strong  norms  of  colleglality  and  instructional  experimentation  and  that 
these  characteristics  are  sufficiently  clear  in  th-se  few  schools  to  make 
their  absence  in  other  schools  highly  salient.   According  to  these 
researchers,  schools  organized  for  continuous  improvement  will  cost  more 
than  the  schools  we  have  now.    However,  we  will  pay  more  late-  for  failing 
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to  encourage  these  norms  now,  and  these  researchers  urge  investments  that 
will  improve  the  conditions  of  teaching.    From  their  perspective,  the 
most  important  prerequisite  for  improvement  is  time  with  colleagues:  time 
for  teachers  to  study,  analyze,  and  improve  instruction.    They  note  that 
1  hour  a  day  might  be  used  to  support  coaching  and  teamwork  to  improve 
lessons,  materials,  and  tests.    In  terms  of  providing  more  time  with 
colleagues,  3  hours  could  be  added  to  the  week,  and  2  weeks  to  the  year. 
It  seems  evident  that  collegiality  is  a  characteristic  of  professional 
behavior.   However,  given  that  the  workplace  discourages  collegial 
intera.tion,  it  seems  clear  that  more  opportunity  must  be  provided  for 
teacher-teacher  interaction  if  teaching  is  to  become  more  professional  in 
nature.    However,  1f  teachers  are  to  benefit  from  this  exchange,  they  must 
possess  an  expanded  technical  knowledge  base. 

Sykes  (1986)  notes  that  school  reform  is  beginning  to  include  an 
Interest  1n  Increasing  teaching's  attractiveness,  In  enhancing  its  inpqe 
as  worthwhile,  satisfying  work.   He  argues  that  professional  standards 
rest  ultimately  on  attitudes,  beliefs,  and  actions  of  teachers.  Teachers' 
commitment  cannot  be  controlled  and  monitored  from  without;  it  must  be 
created  from  within  through  work  processes  in  schools,  and  it  rises  out  of 
Interactions  among  teachers.    Similarly,  Darling-Hanrond  (1986)  believes 
that  peer  review  and  control  are  the  central  tenets  of  professionalism. 
Yet  another  characteristic  of  professionalism  would  be  the  capacity  for 
self-regulation  informed  by  a  professional  knowledge  base  (see  Freidson, 
1984).    Unfortunately  then,  teaching  is  seen  to  be  lacking  another  aspect 
of  professionalism. 
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Research  and  shared  decision  making.    Others,  too,  have  lamented  the 
limited  role  of  educational  research  in  educational  decision  making.  For 
example,  Glaser  (1984)  argues  that  education  is  one  of  the  least  research- 
supported  professions.    Perhaps  this  is  one  of  the  reasons  why  so  little 
widespread  public  support  exists  for  paying  teachers  professional 
salaries.    Further,  although  good  teaching  involves  considerable  art  -- 
and  always  will      (e.g.,  timing,  an  example  that  appeals  to  affective  and 
aesthetic  needs  as  well  as  cognitive  ones),  it  also  represents  an 
opportunity  for  teachers  to  provide  a  basis  for  shared  decision  making,  an 
understanding  of  key  issues,  and  awareness  of  empirical  propositions  that 
have  been  examined  in  actual  classroom  practice  (i.e.,  there  is  also  a 
scientific  basis).   As  Billups  and  Rauth  (1987)  persuasively  argue,  with 
only  "art"  and  no  "scientific"  basis,  public  acceptance  of  teaching  as  a 
profession  is  unlikely  to  occur. 

Others  have  argued  for  enhancing  teachers'  professional  role  by 
providing  research  opportunities  (e.g.,  Rosenholtz,  1989;  Strickland, 
1988).    Conducting  research  should  also  allow  teachers  the  time  and 
resources  to  collect  and  organize  data  and  discuss  their  implications. 
Teachers  tan  work  in  small  or  large  groups  as  appropriate  and  can 
occasionally  collaborate  with  university  researchers.    What  is  important 
1s  that  teachers  share  ideas,  reflect  on  teaching,  and  extend  their 
knowledge  of  alternative  practices.   However,  it  is  clear  that  teachers 
need  time  if  they  are  to  engage  in  the  type  of  reflective  scholarship 
reflected  1n  the  work  of  practitioner-scholars      time  to  make  tapes,  keep 
copious  journals  about  certain  aspects  of  teaching,  and  to  share  these 
ideas  with  colleagues  (see  for  example  Lampert,  1985;  1986a;  1986b). 

f 
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Synthesizing  Teacher-Level.  School -Level .  and  Professional 
Development  Research 

Research  at  both  the  classroom  and  school  levels  paints  an 
increasingly  complex  picture  suggesting  that  successful  teaching  is 
associated  with  numerous  variables  that  can  take  many  forms.    Research  has 
moved  from  a  focus  on  teacher  behavior  (20  years  ago  single  teacher 
behaviors  were  sometimes  the  subject  of  investigations)  to  studying 
reliefs,  intentions,  and  reciprocal  (teacher-student)  causation. 

It  is  now  understood  that  the  context  in  which  teaching  and  learning 
occur  is  of  utmost  importance.    However,  context  itself  is  a  complex, 
multidimensional  variable.    Context  is  more  than  the  definition  of  the 
student  population  (e.g.,  a  high-SES  setting);  it  also  includes  teachers' 
skills  and  dispositions  about  learning* and  change  (e.g.,  Can  some  or  most 
teachers  in  a  school  appropriately  use  small-group  instructional  models 
when  they  choose  to  do  so?).    In  analyzing  teaching-learning  contexts,  the 
subject-matter  knowledge  of  teachers  in  a  school  is  important,  as  are  the 
various  beliefs  that  teachers  hold  about  instruction  (e.g.,  How  do  they 
conceptualize  mathematics?   Does  it  imply  speed  and  right  answers,  or  the 
search  for  patterns  ana  understanding?).    School  practices  and  individual 
students'  learning  experiences  also  are  part  of  context  (Do  students  have 
experience  in  working  in  small  groups,  and  what  is  the  nature  of  this 
experience?). 

Given  the  complexity  of  and  variation  among  instruction-learning 
settings,  research  findings  -  no  matter  how  clear  the  relevant  theory  or 
how  robust  the  findings  -  must  be  interpreted  in  relation  to  individual 
teachers  and  individual  schools.    This  is  not  to  suggest  that  concepts 
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like  alerting  or  wait  time  have  no  general  meaning;  they  have  significant 
implications.    However,  the  effective  implementation  of  a  concept  (e.g., 
from  research  on  teaching)  can  take  many  forms,  and  a  teaching  behavior 
may  be  appropriate  in  some  contexts  but  not  in  others.    Even  behaviors 
that  have  wide  applicability  are  not  useful  in  some  schools  or  classrooms. 
Teachers  must  analyze  and  discuss  findings  and  concepts  from  research  on 
teaching  in  terms  of  their  teaching  situations. 

The  argument  that  teachers  must  "act  upon"  research  has  important 
consequences  for  the  design  of  in-service  and  school- improvement  programs. 
It  suggests  that  school  districts  should  terminate  the  practice  of  moving 
from  program  to  program  and  looking  for  "answers"  from  research.  Rather, 
schools  should  carefully  reflect  on  their  own  opportunities,  define  their 
own  problems,  and  then  identify  relevant  research  and  explore  actions  .that 
the  research  suggests.    Research  would  stimulate  discussion  and  suggest 
alternative  practices. 

The  notion  of  teacher  as  interpreter  and  selective  user  of  research 
provides  an  intriguing  area  for  subsequent  research.    Specifically,  if 
more  schools  used  this  approach  to  organizational  change,  researchers 
could  study  how  different  models  work  in  various  types  of  schools.    As  I 
argued  earlier  in  this  paper,  the  quality  of  a  method  of  organization  or  a 
process  is  much  more  important  than  its  form.    For  example,  small-group 
Instruction  can  be  used  in  ways  that  encourage  students  to  be  more  passive 
or  more  active.    The  use  of  this  method  does  not  predict  students' 
Involvement  or  the  extent  to  which  they  examine  skills  or  concepts. 
Similarly,  institutions  that  alKw  teachers  to  reflect  on  research 
findings  or  research  educational  issues  of  interest  to  them  would 
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implement  the  ideas  and  opportunities  in  various  ways.    Indeed,  the  use  of 
reflective  study  teams  might  control  thinking  about  curriculum  reform  in 
overly-rigid  ways,  resulting  in  unnecessarily  similar  instructional 
approaches.    Various  structural  opportunities  (e.g.,  time  for  face-to-face 
dialogue  with  peer  teachers)  and  resources  provided  to  facilitate  teacher 
decision -making  and  planning  for  curriculum  reform  are  significant  topics 
for  future  research. 

There  are  alternative  ways  for  organizing  information  for  teachers. 
For  example,  researchers  might  summarize  what  is  known  about  differences 
in  more  and  less  "effective"  environments  within  a  particular  context  so 
that  teachers  can  consider  the  value  of  that  information,  particularly  in 
relation  to  their  own  classes  or  schools  (Good,  Grouws,  &  Ebmeier,  1983). 
Similarly,  teachers  can  benefit  from  results  of  research  on  student 
learning  in  a  specific  subjects.    For  example,  Carpenter,  Fennema, 
Peterson,  Chiang,  and  Loef  (1988)  found  that  knowledge  about  how  students 
learn  basic  addition  and  subtraction  was  useful  to  teachers.  However, 
whether  the  information  provided  to  teachers  involves  teaching  behavior  or 
covert  student  variables,  teachers  must  be  encouraged  to  "act  on"  (e.g., 
evaluate)  the  information. 

Areas  of  Research  that  Merit  Investment^ 
As  I  mentioned  previously,  many  potential  research  topics  are  not 
discussed  in  this  paper  (teacher  recruitment  generally  or  minority 
recruitraent  specifically,  home-school  communication,  computer  usage, 
comparative  studies,  and  knowledge  utilization  studies  to  name  but  a  few). 
Further,  I  want  to  stress  that  my  intent  here  is  not  to  order  research 
priorities  or  to  suggest  the  design  for  specific  studies.    Rather,  I  want 
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to  Illustrate  some  of  the  many  types  of  research  that  could  --  and  I 
believe  that  should  --  be  funded  in  order  to  enhance  the  knowledge  base  of 
classroom  and  school  learning.    I  believe  that  increasing  this  knowledge 
can  assist  in  the  design  of  schools  that  encourage  more  reflective  and 
productive  performance. 
Teacher  Research  and  Scholarship 

If  educators  and  policymakers  are  interested  in  stimulating  school 
improvement  efforts  that  enrich  both  classrooms  and  schools,  they  need  to 
give  teachers  opportunities  to  explore  curriculum  and  instruction  and  to 
share  their  thinking  with  one  another.    For  example,  fourth-grade 
teachers  might  want  to  improve  students'  thinking  (processes  and  products) 
during  small -group  instruction.   A  pair  of  teachers  who  work  in  a  high- 
arid  a  low-SES  school  might  tape  record  a  representative  group  of  four  or 
five  students  during  small-group  assignments,  on  repeated  occasions. 
After  studying  the  tapes  and  defining  the  problem,  the  teachers  could  read 
relevant  literature,  consult  with  other  teachers  in  the  district  and 
researchers  who  have  conducted  studies  in  the  area,  and  develop  a  plan  for 
altering  curriculum  or  instruction.   The  two  teachers  could  observe  one 
another's  classes  (watching  students  interact)  and  assess  the  effects  of 
changes  on  students.    The  tape  recordings  would  be  available  for 
reanalysis  by  other  interested  teachers  and  researchers  who  might  define 
success  1n  various  ways.    Thus,  like  all  scholarly  activity,  the  research 
would  be  conducted  by  people  who  are  experts  (certainly  no  one  would  know 
the  classroom  context  and  the  needs  of  students  any  better  than  the 
teachers  conducting  the  study  and  other  teachers  in  the  district  who  teach 
similar  students)  and  would  include  peer  and  professional  review. 


There  are  many  potential  advantages  of  teacher  research  and 
scholarship.    For  example,  they  help  teachers  to  think  more  deep^  about 
problems  and  issues  —  especially  problems  that  teachers  can  helo  to 
solve.    As  noted  aarlier  in  the  paper,  much  unsuccessful  curriculum  reform 
has  been  generated  by  persons  who  have  little  information  about  classroom 
and  school  factors  that  may  hinder  reform.    Further,  teachers  seldom  have 
the  chance  to  discuss  ideas  with  other  teachers.    Thus,  by  promoting  the 
sharing  of  resources  and  ideas  among  teachers  who  teach  in  similar 
contexts  (e.g.,  same  grade,  same  topic)  and  different  ones  (e.g.,  students 
of  varied  achievement)  research  can  illustrate  to  teachers  how  an 
instructional  behavior,  for  example,  might  have  different  effects  in 
various  settings. 

With  any  research,  the  critical  factors  are  the  skill  of  the 
researchers  and  the  usefulness  of  the  questions  raised  by  the  research.  I 
suggest  that  teachers  be  allowed  to  explore  any  question  that  they  deem 
relevant.   However,  some  secondary  guidelines  for  evaluating  research 
proposals  might  be  useful.   Although  it  should  be  possible  to  fund 
significant  projects  submitted  by  individual  teachers,  teachers  should  bo 
encouraged  to  submit  proposals  jointly,  since  teachers  otherwise  work 
primarily  in  isolation.    Thus,  perhaps  a  small  preference  should  be  given 
to  joint  proposals.  <* 
A  second  guideline  would  require  some  clear  support  of  projects  from 
the  district  (e.g.,  perhaps  matching  one-half  the  cost  of  the  grant).  If 
schools  do  not  allow  time  for  teachers  to  reflect  on  schooling  and  discuss 
it  with  peers,  then  the  district  should  provide  teachers  with  sufficient 
release  time  to  do  so. 
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Third,  proposals  involving  research  that  affects  both  classrooms  and 
schools  should  be  favored.    For  example,  there  is  considerable  evidence  of 
needless  redundancy  of  content  (see  McKnight  et  al . ,  1987)  so  that  a 
research  project  that  would  lead  to  comprehensive  curriculum  knowledge  and 
to  greater  coordination  of  curriculum  and  instruction  among  grades  in  a 
school  would  be  very  useful.    Another  means  of  assuring  participation  of 
teachers  at  various  grades  in  research  would  be  to  require  teachers  who 
are  funded  to  report  on  their  study  to  the  entire  school.    All  teachers  in 
the  school  could  debate  the  usefulness  of  knowledge  from  the  research  at 
various  grades. 

Teachers'  Performance  Expectations 

Although  much  is  known  about  how  teachers  form  and  communicate 
expectations  for  individual  students,  little  is  known  about  how  teachers 
develop  expectations  for  entire  classes  of  students.    It  seems  instructive 
to  inquire  into  this  process  for  all  teachers,  but  especially  for 
beginning  teachers.   Many  teachers  have  not  had  much  experience  teaching 
or  observing  at  a  grade  level  until  they  have  a  formal  contract  and  begin 
teaching.    For  example,  a  beginning  teacher  may  observe  in  a  first-grade 
classroom  as  a  requirement  of  a  university  class,  student  teach  in  a 
third-grade  class,  and  then  begin  teaching  in  a  sixth-grade  class.  Thus, 
a  teacher  may  be  especially  likely  to  adopt  the  norms  held  by  other 
teachers  at  the  same  grade  leve^  in  the  school  in  which  the  teacher  first 
teaches.   Obviously,  mentor  teachers  or  more  experienced  teachers  may  also 
have  limited  knowledge  of  appropriate  performance  expectations  for 
students  at  particular  grade  levels. 
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One  wonders  how  teachers  learn  what  constitutes  appropriate  subject- 
matter  teaching  (e.g.,  level  of  cognitive  sophistication)  at  a  particular 
grade.    How  can  teachers  determine  what  constitutes  appropriate  and 
accurate  subject-matter  teaching  to  a  particular  class  of  students? 
Could  teachers  of  equal  talent  who  start  to  teach  in  similar  contexts 
(e.g.,  same  grade  level,  same  type  of  pupils)  develop  radically  different 
conceptions  of  what  is  important  and  appropriate?    If  so,  how  do  these 
conceptions  influence  classroom  assignments  and  interactions  with 
students?   Do  teachers'  performance  expectations  for  students  influence 
students'  beliefs  about  various  subjects?   How  can  btginning  teachers 
gather  and  analyze  useful  data  about  appropriate  performance  standards  for 
classes  and  for  individual  students?   Do  teachers  discuss  issues 
associated  with  content  selection  and  pace,  and  how  do  they  decide  on 
appropriate  standards? 

Within  this  general  theme,  one  could  empirically  study  many 
questions.    For  example,  do  teachers  who  student  teach  at  the  same  grade 
(or  an  adjoining  one)  at  which  they  begin  teaching  develop  more 
appropriate  conceptualizations  of  teaching  than  other  teachers?   Do  these 
teachers  simply  continue  to  do  what  was  modeled  for  them  in  student 
teaching,  with  comparatively  little  reflection? 

Obviously,  countless  questions  could  be  raised  about  beginning 
teachers  and  how  they  learn  to  teach.    However,  considering  the  growing 
Interest  in  the  normative  influence  of  colleagues  on  teachers  and  in 
subject-matter  teaching,  it  is  important  to  examine  how  teachers  develop 
performance  expectations  for  students  in  various  subjects.  Virtually 
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nothing  is  known  about  this  topic,  and  research  and  development  might 
increase  teachers'  expectations. 
Creating  New  Student  Outcome  Measures 

Teacher-  and  school -level  research  have  resulted  in  a  growing 
interest  in  addressing  higher-order  outcomes.    In  many  districts  teacher 
accountability  measures  determine  the  curriculum.    This  is  unfortunate, 
because  most  accountability  devices  yield  a  narrow  definition  of 
curriculum.    Some  situations  are  particularly  tragic.    For  example, 
despite  massive  funding  of  Title  I  ant1  Chapter  I  programs,  many  low- 
achieving  students  continue  to  have  difficulty  in  mastering  basic  skills. 
The  focus  on  basic  skills  often  initiates  a  chain  of  events  that  almost 
guarantees  that  many  students  will  make  little  progress.  Because 
assessment  of  remedial  programs  stresses  mastery  of  basic  skills,  teachers 
who  believe  that  low-achieving  students  need  more  practice  and  drill  if 
they  are  to  master  basic  concepts  may  overemphasize  drill  and  practice. 
Students  are  exposed  to  the  same  concepts  year  after  year  and  continue  to 
memorize  formulae  and  processes  that  are  neither  meaningfully  presented 
nor  studied  in  a  motivating  context.    The  curriculum  is  often  so  narrowly 
focused  that  many  low  achievers  do  not  understand  the  general  principles 
and  concepts  that  are  associated  with  the  skills.    Moreover,  since  most 
learning  in  some  contexts  involves  rote  memorization,  any  learning  that 
occurs  is  quickly  forgotten.    When  achievement  tests  indicate  that 
students'  performance  on  basic  skills  has  not  improved  substantially, 
pressure  for  drill  and  practice  increases. 

There  is  good  reason  to  believe  that  a  balanced  instructional  program 
that  focuses  simultaneously  on  skills,  concepts,  and  problem  solving  could 
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help  students  to  become  more  active  and  successful  problem  solvers. 
Greeno  (1989)  suggests  that  a  key  question  related  to  emphasizing  critical 
thinking  is  whether  individuals  can  think  reflectively  rather  than  simply 
carry  out  procedures  or  statements  without  any  real  understanding. 

Since  the  brain  codes  and  processes  information,  virtually  any 
stimulus  from  the  environment  will  produce  some  thought.    Newmann  (in 
press)  notes  that  all  cognitive  processes,  for  example,  watching  a 
baseball  game,  reading  a  map,  or  listening  to  a  teacher,  are  "complex"  in 
a  neurological  sense.    How,  then,  can  one  distinguish  higher-order 
thinking  from  other  forms  of  thinking?  Newmann  (pp.  4-5)  makes  the 
distinction  in  the  following  way:    "Lower-order  thinking  demands  only 
routine,  mechanistic  application  of  previously  acquired  knowledge;  for 
example,  repetitive  exercises  such  as  listing  information  previously 
memorized,  inserting  numbers  into  previously  learned  formulae,  or  applying 
the  rules  for  footnote  format  in  a  research  paper.    In  contrast,  higher- 
order  thinking  challenges  the  student  to  interpret,  analyze,  or  manipulate 
information,  because  a  question  to  be  answered  or  a  problem  to  be  solved 
cannot  be  resolved  through  the  routine  application  of  previously  learned 
knowledge." 

Obviously,  this  distinction  is  relative,  because  what  constitutes  a 
challenge,  puzzle,  or  higher-order  thinking  for  one  student  might  only  be 
a  repetitive  exercise  for  another  student.    Thus,  research  in  the  1990s 
will  need  to  explore  how  particular  teacher  examples  or  assignments 
encourage  students  to  analyze  and  integrate  the  new  information  and 
assignments.    In  t  is  sense,  the  study  of  teacher  behavior  becomes  a 
fundamental  challenge  when  researchers  ask  questions  about  how  teaching 
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influences  student  thinking.    For  example,  when  they  ask  what  makes  a 
good  lesson  presentation,  the  answer  may  vary  depending  on  what  one  wants 
students  to  do  (e.g.,  to  know  how  others  have  defined  the  problem,  how 
others  have  attempted  to  solve  the  problem,  or  to  attempt  new  and  novel 
responses) . 

Newmann  (in  press)  is  developing  observational  scales  in  an  attempt 
to  identify  social  studies  classrooms  that  are  "mindful"  (encourage 
higher-order  thought)  versus  those  with  ?  routine,  mechanistic  focus.  As 
the  history  of  research  on  teaching  indicates,  effective  teacher  behaviors 
are  varied,  and  what  works  in  one  classroom  context  may  not  necessarily 
work  in  another.    The  empirical  investigation  of  "mindful"  social 
interaction  and  thought  is  intriguing  and,  I  believe,  important.  However, 
I  want  to  stress  that  this  work  will  not  yield  a  list  of  the  key 
characteristics  of  classrooms  that  encourage  higher-order  thought  but 
rather  will  offer  concepts  and  terms  that  allow  meaningful  distinctions 
among  teachers  and  classrooms.    What  30  or  40  characteristics  describe  a 
"mindful"  social  studies  classroom  and  how  might  that  classroom  differ 
from  a  "mindful"  science  classroom?  Do  Chapter  I  classrooms  have  unique 
constraints  on  mindfulness?   What  are  some  of  the  important  ways  in  which 
context  variables  (age  of  students  and  type  of  school  setting)  interact? 
By  anticipating  both  general  findings  and  context  effects,  researchers  are 
more  likely  to  discover  relevant  characteristics  than  if  they  assume  that 
the  outcomes  will  be  general  (or  highly  situational).    If  progress  is  to 
be  made  in  this  area,  several  studies  that  examine  different  contexts 
should  be  funded. 
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Because  teachers  are  vulnerable  to  external  pressures,  including  an 
emphasis  on  test  scores,  they  are  unlikely  to  include  higher-level 
objectives  in  classes  populated  by  low-achieving  students  unless 
accountability  devices  are  changed  substantially;  particularly  in  the 
early  grades,  where  the  greatest  percentage  of  test  items  now  cover 
"drill able"  content.    Moreover,  defining  the  curriculum  in  terms  of  a  test 
imposes  problems  for  all  students.   For  example,  many  talented  students 
study  content  that  they  have  mastered  in  earlier  grades. 

Attention  to  students'  ability  to  use  information,  to  collect  data, 
to  pose  interesting  questions,  to  use  subject  matter  to  answer  their  own 
questions  is  needed  in  addition  to  the  study  of  basic  skills.    It  is  now 
time  for  educators  to  emphasize  these  outcomes  of  schooling  that  have  been 
neglected.   Although  important  advances  have  occurred  in  educators' 
thinking  about  successful  instruction,  most  achievement  tests  do  not 
measure  students'  progress  on  the  basis  of  this  modern,  comprehensive  view 
of  learning.    Thus,  we  cannot  assess  whether  instruction  that  combines 
adequate  subject-matter  knowledge,  pedagogical  content  knowledge,  and  the 
ability  to  construct  classroom  environments  that  call  for  both  active 
student  learning  and  active  teaching  improves  students'  higher-order 
thinking  skills.    Unless  we  develop  better  outcome  measures,  we  will  be 
forced  to  accept  claims  about  the  influence  of  curriculum  approaches  on 
students'  higher-order  thinking  skills  with  no  compelling  evidence,  or  we 
will  simply  have  to  ignore  the  issue.    It  seems  to  me  that  neither  of  the 
latter  positions  is  acceptable. 

I  do  not  advocate  state-mandated  (or  federal)  testing  programs,  and  I 
believe  that  money  spent  on  these  programs  wastes  valuable  resources  that 
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could  be  spent  on  other  activities.    For  example,  some  states  test  all 
students  at  a  particular  grade  level,  when  other  designs  would  yield 
equally  valuable  information  and  save  a  vast  amount  of  money  that  could  be 
reallocated  to  activities  that  would  be  of  more  use  in  improving  teaching- 
learning.   My  comments  here  in  terms  of  the  need  to  develop  new  assessment 
devices  are  not  an  argument  for  improving  state-mandated  testing  programs. 
New  instruments  that  are  carefully  conceptualized  and  validated  would  help 
many  schools  to  more  successfully  reflect  on  and  plan  for  improving  their 
curricula.    Further,  to  address  sophisticated  questions  about  the  effects 
of  multiple  variables  on  student  learning,  researchers  will  also  need 
better  instruments.    However,  if  states  rather  than  individual  schools  and 
local  communities  insist  on  using  state-mandated  testing  programs,  then  it 
seems  imperative,  for  those  states  to  develop  assessment  procedures  that 
examine  student  performance  in  more  sophisticated  and  diverse  ways. 
Curriculum 

With  the  increasing  interest  in  subject-matter  variables  in 
classrooms,  it  is  important  to  encourage  research  that  identifies  key 
concepts  in  various  subjects  and  to  begin  programs  of  development.  Much 
has  been  written  about  the  need  for  mathematics  teachers  to  focus  more  on 
problem  solving,  but  relatively  little  conceptualization  has  been  given  to 
the  nature  of  the  problems  students  are  to  explore.    In  what  ways  do  good 
problems  at  the  third-  and  sixth-grade  level  differ?   What  concepts  should 
be  taught  in  fourth-,  fifth-,  and  s^xth-grade  science  and  mathematics?  As 
teacher-researchers  and  researchers  identify  those  concepts,  the  study  of 
many  related  issues  could  be  structured.   What  strategies  are  best  for 
teaching  particular  concepts?   How  can  research  identify,  extend,  and 
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validate  extant  pedagogical  content  knowledge?   How  can  researchers 
identify  the  knowledge  teachers  possess  and  how  can  they  use  information 
coining  from  cognitive  science  and  other  research  in  order  to  enhance 
teachers*  knowledge  of  subject-matter  teaching? 

What  beliefs  do  teachers  hold  about  teaching  generally,  and  math  and 
science  specifically,  at  grades  four,  five,  and  six  arJ  how  do  these 
beliefs  influence  teaching  of  particular  subject-matter  concepts?    Is  it 
possible  to  document  relationships  between  clusters  of  teacher  behavior: 
(including  teachers'  subject-matter  knowledge,  pedagogical  content 
knowledge,  knowledge  of  how  students  learn  particular  content,  and  general 
knowledge  of  teaching),  and  how  teachers  help  students  learn  certain 
concepts,  as  well  as  the  effects  of  such  strategies  on  students'  learning 
and  performance? 

Some  important  work  has  been  started  in  this  area,  and  it  is  clear 
that  satisfactory  performance  does  not  necessarily  guarantee  that 
students'  understanding  of  concepts  is  adequate.    Ball  and  McDiarmid  (in 
press)  note  that  in  various  subjects  there  is  growing  evidence  that 
students  can  produce  satisfactory  work  without  understanding  the  subject 
matter.    Similarly,  Schoenfeld  (1985)  describes  the  inability  of  his 
undergraduate  mathematics  students  (most  of  whom  had  done  well  in  an 
earlier  college  calculus  course)  to  explain  some  fairly  simple  geometric 
problems.   Although  the  students,  working  as  a  group,  could  solve  the 
problems,  they  struggled  to  explain  why  a  particular  solution  had  worked. 

A  recent  examination  of  the  problem  of  mathematics  instruction  in  the 
United  States  is  summarized  in  the  114-page  report,  Everybody  Counts-  a 
v       Report  to  the  Nation  on  the  Future  of  Mathematics  EjaaMflg  This 
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document  contends  that,  "today's  schools  labor  under  the  legacy  of  a 
structure  designed  for  the  industrial  age  misapplied  to  educate  children 
for  the  information  age."    If  this  strong  message  is  correct,  then  the 
basic  mathematics  curriculum  needs  drastic  changes.    However,  we  have 
1  Utile  evidence  on  or  conceptualization  of  what  the  curriculum  for  the 
information  age  should  look  like  and  how  that  curriculum  might  vary  across 
contexts  (e.g.,  an  inner-cuy  elementary  school;  a  suburban  high  school;  a 
rural  middle  school).    It  is  time  to  begin  this  important  work.  Although 
there  are  many  ways  to  approach  the  curriculum  issue,  one  interesting 
framework  is  the  notion  of  students'  misconceptions  that  prevent  students 
from  understanding  new  information  or  new  instructional  activities 
(potentially  valuable  ,^w  data  or  instruction  is  misperceived  because  of 
inadequate  or  faulty  cognitive  structures).    Thus,  educators  must 
determine  what  common  misconceptions  students  hold.    How  can  we  identify, 
extend,  and  validate  knowledge  of  instructional  strategies  that  help 
students  to  develop  more  accurate  and  useful  conceptions?   Does  successful 
teaching  in  grade  four  (i.e.,  appropriate  use  of  pedagogical  content 
knowledge  and  subject-matter  knowledge)  allow  grade  five  teachers  to  spend 
less  time  correcting  misconceptions  and  more  time  presenting  new  concepts 
or  exploring  new  applications  of  concepts  that  students  have  previously 
learned?    If  the  knowledge  of  teaching  subject  matter  in  particular 
settings  (e.g.,  science  and  mathematics  concepts  ii;  fourth,  fifth,  and 
sixth  grades)  becomes  more  advanced,  how  might  the  considerable  time 
previously  used  in  grade  six  to  reteach,  review,  and  correct  students' 
misconceptions  be  reallocated  so  that  sixth-grade  students  could  explore 
science  and  mathematics  in  novel  ways? 
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Student  Mediation 

It  is  important  to  explore  the  conditions  under  which  students  are 
encouraged  to  think.    Recent  research  and  conceptualization  (e.g., 
Wittrock,  1986)  have  focused  on  how  studants  process  information  from 
teachers,  textbooks,  or  classroom  activities.    However,  there  is  virtually 
no  information  about  which  assignments  and  teacher  behaviors  are  more 
likely  to  engage  student  thinking.   What  constitutes  a  good  seatwork 
activity  or  good  end-of-the-chapter  questions?   Does  the  quality  of  good 
seatwork  tasks  vary  with  student  ability  and  their  perceptions  of  the  task 
or  are  there  some  general  characteristics  that  can  be  articulated? 

It  is  popular  to  assume  that  when  students  "do"  they  are  more  likely 
to  think,  although  there  is  little  evidence  on  this  topic.    Activity  in 
classrooms  is  in  many  respects  similar  to  activities  elsewhere.  For 
example,  one  would  not  argue  that  U.S.  automobile  factory  workers  on  an 
assembly  line  engage  in. much  job-related  systematic  thinking.  Similarly, 
activities  that  involve  students  in  applied  work  may  not  stimulate  their 
thinking,  particularly  if  students  engage  in  them  frequently.  For 
example,  many  students  will  "tune  out"  if  they  frequently  work  in  groups. 
When  teachers  lecture  for  long  periods,  many  students'  attention  may  begin 
to  wander,  although  certain  types  of  teacher  talk  may  stimulate  active 
thinking.    Research  needs  to  describe  various  types  of  classroom 
presentations  and  activities  and  whether  these  stimulate  student  thinking 
and  covert  reaction. 

Covert  thinking.    Several  theories  could  serve  as  a  basis  for  this 
research.    For  example,  Rohrkemper  (in  press)  argues  that  inner  speech 
guides  thought  and  action  as  students  attempt  to  deal  with  learning 
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situations.    Tie  notes  that  two  distinct  types  of  inner  speech  have  been 
Identified  and  represent  the  potential  integration  of  the  affective  and 
the  intellectual.    Self-involved  inner  speech  reflects  control  ovsr  the 
self  through  enhancing  motivational  and  affective  statements,  whereas 
task- involved  inner  speech  involves  control  over  a  task  through  problem 
solving  and  attempts  to  modify  the  task  to  make  it  more  understandable  or 
more  "doable."   Thus,  in  combination,  self-involved  and  task-involved 
inner  speech  may  allow  students  to  function  in  adaptive  ways  oither  by 
enabling  them  to  change  a  task  or  to  modify  their  self-perceptions  and/or 
effort. 

Students  bring  complex  histories  to  school  learning  tasks.  They 
differ  not  only  in  the  ways  in  which  they  have  achieved  mastery  over 
particular  concepts  or  the  cognitive  skills  they  possess  but  also  in 
whether  they  can  use  sel f- involved  inner  speech  in  relevant  and  adaptive 
ways.    Some  students  have  learned  to  use  their  resources  to  deal  with 
difficulty.   Others  have  learned  to  give  up  or  to  turn  to  others  for  help 
when  they  have  trouble  learning.    How  students  at  various  levels  benefit 
from  Interaction  with  the  teacher  or  with  peers  is  far  from  clear  and  is 
an  important  topic  for  research.    What  happens  when  particular  students 
are  grouped?   If  one  student  in  a  group  cannot  use  self-involved  and  task- 
involved  inner  speech  with  facility,  is  this  an  advantage  or  a 
disadvantage?   Although  it  is  currently  popular  to  argue  that  grouping 
promotes  active  learning,  we  do  not  know  how  tasks  and  group  membership 
affect  the  information  processing  of  individual  learners.   Such  research 
should  be  funded  so  that  student  thinking  in  classrooms  can  be  examined. 


61 

Problem-solving  stvle.    Recent  cognitive  science  research  has 
produced  some  fascinating  findings  about  individual  learners  in  laboratory 
settings  and  research  on  student  learning  continues  to  yield  interesting 
findings.    However,  as  exciting  as  these  findings  are,  ti>eir  application 
to  classroom  learning  is  problematic.    In  one  such  study   Duemler  and 
Mayer  (1988)  examined  students'  reflection  in  non-classrooni  problem- 
solving  situations.    They  explored  the  prediction  of  rationality  theory 
(e.g.,  Baron,  1985)  that  more  reflective  individuals  perform  better  on 
problem-solving  tasks  than  more  impulsive  individuals.    In  assessing 
students'  scientific  reasoning,  they  noted  that  some  students  were  likely 
to  verbalize  their  hypotheses  much  more  rapidly  than  other  students,  who 
waited  for  more  evidence.    These  investigators  wanted  to  explore  the 
influence  of  this  behavior  --  willingness  to  express  hypotheses  --  on 
problem-solving  success. 

In  two  experiments  using  college  students  and  employing  different 
dependent  measures,  Duemler  and  Mayer  obtained  consistent  results  --  a  U- 
shaped  relationship  between  the  subjects'  tendencies  to  state  incorrect 
hypotheses  on  conventional  rule-induction  problems  and  subsequent  success 
1n  solving  an  unconventional  problem.    That  is,  students  who  never  stated 
incorrect  hypotheses  on  conventional  problems  performed  relatively  poorly 
on  solving  an  unconventional  problem.    The  researchers  reasoned  that  these 
students'  poor  performance  might  have  occurred  because  their  search  for 
problem  solutions  focused  on  conventional  hypotheses.    In  contrast, 
subjects  who  sometimes  stated  incorrect  hypotheses  for  conventional 
problems  tended  to  perform  well  on  an  unconventional  problem.  According 
to  Duemler  and  Mayer,  this  is  probably  because  these  students'  hypothesis- 
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generation  styles  allowed  them  to  develop  unconventional  hypotheses  and  to 
systematically  evaluate  these  hypotheses. 

Do  these  results  apply  to  a  teacher  who  works  with  the  class  as  a 
whole?   Do  they  suggest  that  the  teacher  should  develop  students'  capacity 
to  verbalize  reasonable  hypotheses,  or  that  students  should  have  more 
domain-specific  information  that  might  reduce  memory  load  and  hence  make 
it  easier  for  them  to  generate  relevant  hypotheses?   What  implications 
does  Duemler  and  Mayer's  work  have  for  teachers  who  assign  students  to 
four-  or  five-person  teams?   Does  it  suggest  that  there  should  be  a  mix  of 
impulsive  and  reflexive  learners?   Does  the  appropriate  match  or  mismatch 
of  students  on  the  basis  of  reflexive  style  vary  as  a  function  of  tasks, 
age  of  students,  subject  matter,  or  friendship  patterns?    I  want  to 
emphasize  that  I  find  the  Duemler  and  Mayer  study  valuable;  however,  such 
studies  must  be  conducted  in  classrooms,  where  numerous  variables  affect 
student  performance. 

It  is  clear  that  students  think  and  that  their  thinking  mediates 
teacher  behavior  and  class  assignments  (the  same  assignment  will  mean 
different  things  to  different  students).    However,  research  needs  to 
explore  what  teacher  statements  and  classroom  activities  stimulate  higher- 
order  thinking,  especially  on  the  part  of  students  who  have  been  passive 
learners  for  several  years.    It  seems  especially  important  to  integrate 
theories  of  learning  and  development  --  for  example,  the  role  of  social 
language  in  facilitating  learninq  (Rohrkemper,  in  press)  with  theories  of 
classroom  contexts.    We  need  comprehensive  naturalistic  and  experimental 
studies  of  how  student  developmental  variables  interact  with  student 
learning  styles  (e.g.,  learned  passivity)  in  various  learning  situations 


ERIC 


111 


63 

(e.g.,  rural  classrooms).    These  studies  can  examine  both  instructional 
and  curriculum  variables. 

Classroom  organization.    Another  factor  that  affects  student  thinking 
i)s  classroom  organization.    I  believe  that  Sinall-group  instruction  can 
enhance  students'  higher-order  cognitive  skills.    When  I  point  out  the 
limitations  of  small-group  instruction,  I  do  so  only  because  •  want  to  see 
the  format  used  appropriately.    There  is  a  tendency  to  equate  small  groups 
with  increased  student  activity  and  thinking.    However,  some  sophisticated 
research  illustrates  that  small-group  instruction,  like  whole-class 
instruction,  has  various  effects  and  that  the  quality  of  instruction  is 
most  important. 

Peterson  and  Janicki  (1979)  studied  fourth-,  fifth-,  and  sixth-grade 
students'  academic  and  affective  responses  to  small-group  and  whole-class 
learning  situations.   Their  data  showed  that  low-ability  students  achieved 
better  in  whole-class  settings.    Janicki  and  Peterson  (1981)  found  that 
both  high-  and  low-ability  students  had  more  positive  attitudes  toward 
mathematics  in  the  whole-class  context  than  in  the  small-group  context. 
Students  who  initially  had  more  positive  attitudes  toward  math  and  who  had 
a  high  internal  locus  of  control  did  worse  in  learning  situations  in  which 
direct  instruction  was  utilized. 

Cooperative  curriculum  \*<i\c*     in  addition  to  classroom  organization, 
the  curriculum  tasks  that  students  are  assigned  also  affect  students' 
thought  processes.    Good,  Reys,  Grouws,  and  Mulryan  (1988)  report  that 
students  who  have  been  asked  to  work  cooperatively  in  small,  heterogeneous 
work  groups  often  work  independently  in  part  because  they  have  done  so  in 
previous  years.    Thus,  tasks  must  be  carefully  designed  to  encourage 
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cooperative  behaviors.    Even  when  efforts  are  made  to  insure  that  a  task 
is  significant  and  calls  for  cooperation,  some  high-ability  students  still 
prefer  to  work  alone. 

Other  students  may  become  relatively  passive  in  groups.  Indeed, 
there  is  clear  evidence  that  many  students  have  learned  to  withdraw  from 
classroom  learning  situations  and  seldom  initiate  contact  with  teachers 
about  academic  issues  (e.g.,  Good  et  al.,  1987).    How,  then,  do  teachers 
deal  with  students  who  have  learned  not  to  verbalize  their  tentative 
thoughts  and  that  sharing  information  often  leads  to  the  perception  that 
they  are  inferior  to  other  students?   Research  that  examines  how  students 
Interact  in  small  cooperative  groups,  that  compares  student  thinking  and 
student  success  across  various  dimensions  and  types  of  tasks,  would  help 
its  better  understand  when  and  how  grouping  can  stimulate  productive 
student  thinking. 

Generality  of  cognitive  task     Another  important  variable  in  student 
mediation  research  is  the  level  at  which  students'  cognition  is  addressed. 
Although  some  cognitive  science  theorists  argue  that  adaptive  thinking  is 
very  situation-specific  (e.g.,  Greeno,  1989),  other  theorists  are  more 
optimistic  about  the  potential  of  schools  to  enhance  students'  cognitive 
ability.    For  example,  Perkins  and  Salomon  (1989)  note  that  a  belief  in 
the  generality  of  cognitive  skills  is  to  some  extent  on  the  rebound.  At 
one  time,  psychologists  argued  strongly  for  the  generality  of  cognitive 
skills.    Then  the  field  went  through  a  period  in  which  it  was  popular  to 
argue  that  cognitive  skills  are  highly  context-specific.   According  to 
Perkins  and  Salomon,  early  advocates  of  the  importance  of  general 
cognitive  skills  paid  too  little  attention  to  the  need  for  a  rich 
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knowledge  base  and  spent  little  time  theoretically  articulating  how  skill 
transfer  was  to  occur.    Because  of  these  mistakes,  many  critics  expressed 
considerable  skepticism  about  the  value  of  general  cognitive  skills. 
However,  these  overreactions  have  caused  problems  as  well  --  most  notably 
the  failure  to  recognize  how  general  heuristics  help  when  experts  face 
atypical  problems  in  a  domain,  how  general  heuristics  can  help  an 
individual  to  use  domain-specific  knowledge,  and  how  lack  of  conditions 
needed  for  transfer  (rather  than  domain  specificity)  may  be  to  blame  for 
many  cases  of  failure  of  transfer. 

Perkins  and  Salomon  make  the  interesting  and  useful  distinction 
between  educating  memories  and  educating  minds.    They  argue,  "to  be  sure, 
general  heuristics  that  fail  to  make  contact  with  the  rich  domain-specific 
knowledge  base  are  weak.    But  when  a  domain-specific  knowledge  base 
operates  without  general  heuristics,  it  is  brittle  --  it  serves  mostly  in 
handling  formulaic  problems.   Although  we  don't  want  the  weak  results  of 
the  kind  of  attention  to  general  heuristics  that  neglects  knowledge  base, 
we  also  don't  want  the  brittle  competency  forged  by  extensive  attention  to 
particularized  knowledge!   We  would  hope  for  more  from  education.  And 
according  to  the  synthesis  theory,  we  can  get  more"  (page  23). 

These  authors  point  out  that  most  efforts  to  develop  general 
cognitive  skills  have  not  focused  on  bringing  together  context-specific 
knowledge  and  general  strategic  knowledge.    They  argue  that  education  now 
needs  this  integration,  that  it  needs  to  gr  beyond  educating  memories  to 
educating  minds,  which  is  the  central  issue  of  education. 

According  to  Perkins  and  Salomon  (1987,  1988),  there  are  now 
guidelines  available  for  classroom  practices  that  can  foster  the  transfer 
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of  knowledge  and  skills.    Studies  suggest  that  certain  general  skills 
that  seem  to  have  a  reasonable  degree  of  generality  can  be  taught  directly 
(e  g.,  Palincsar  &  Brown,  1984).    It  would  seem  that  research  studying  how 
studen'  mediation  variables  operate  in  specific  curriculum  areas  would  be 
of  considerable  importance.    What  are  general  cognitive  skills  we  would 
want  students  to  have  for  dealing  with  "data"  (or  whatever)  in  fifth-grade 
science  and  math  classes  and  how  do  explicit  forms  of  student  thinking 
influence  the  level  of  generality  at  which  the  concepts  of  "data"  can  be 
learned  in  a  classroom  setting. 

Again,  I  want  to  call  attention  to  how  fragile  the  knowledge  base  in 
student  mediation  is.    Although  a  few  studies  have  examined  student 
behavior  during  small-group  instruction,  few  have  examined  both  student 
behavior  and  student  thinking.    Fewer  studies  yet  have  looked  at  how  task 
demands  influence  students'  conceptualization  (Is  cooperation  among 
students  required?    Is  detailed  domain-specific  information  required?). 
At  this  point,  needed  are  comprehensive  strategies  that  explore  how 
organization  (large  group,  small  group)  tasks  and  student  mediation 
operate  simultaneously. 

Arguments  about  the  importance  of  student  mediation  during 
instruction  is  becoming  increasingly  complex  and  several  models  have  been 
developed  for  helping  to  explain  why  students  sometimes  have  difficulty  in 
understanding  key  concepts  ...  concepts  that  often  teachers  spend  a  lot  of 
time  on  in  instructing  students  (e.g.,  Perkins  &  Simmons,  1989).  The 
richness  of  cognitive  science  basic  research,  however,  needs  to  be  brought 
into  the  classroom  and  we  need  to  begin  to  explore  how  students  react  to 
specific  lessons  under  known  instructional  conditions. 
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We  need  to  make  maior  investments  exploring  various  students  in 
various  contexts  (e.g.,  first  graders  learning  to  read,  college  students 
exploring  introductory  physics  concepts).    We  need  to  recognize  that  much 
basic  research  needs  to  be  funded  exploring  student  mediation  and  thinking 
in  actual  classroom  situations.    Laboratory  research  has  been  important 
and  should  be  continued;  however,  we  need  to  recognize  that  students  learn 
in  complex  social  environments  and  we  need  to  explore  cognition  in  those 
settings.    Further,  the  attempt  must  not  be  to  teach  students  simply 
skills  but  rather  to  assist  students  to  reflect  and  think  in  complex 
environments. 

The  argument  here  is  not  necessarily  for  applied  work  simply  because 
the  focus  is  on  classroom  learning.    Rather,  I  believe  that  OERI  should 
invest  heavily  in  basic  research  studies  that  attempt  to  determine  how 
students  think  during  various  classroom  events.    Do  students  attend  more 
to  teacher  presentations  than  peer  presentations  and  is  this  true  across 
different  types  of  tasks?  How  long  do  students  attend  to  any 
informational  source  (whether  reading  silently  or  talking  to  a  lab 
partner)?   We  need  a  generation  of  research  on  cognition  in  classroom 
settings.    Thomas  (1980,  1984)  argues  convincingly  that  the  miracle  drugs 
of  the  20th  century  were  the  direct  antecedents  of  100  years  of  prior  pure 
and  often  seemingly  irrelevant  science.   Thus,  again,  I  argue  that 
research  is  needed  that  explores  basic  cognitive  processing  of  students 
during  classroom  instruction  with  no  necessary  intent  upon  improving 
instruction  in  the  short  run.   We  need  to  understand  how  students  process 
and  perceive  information  under  various  classroom  conditions.   However,  as 
argued  earlier,  we  do  need  to  more  critically  conceptualize  the  issue  of 
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student  thinking  within  specified  boundaries  --  in  response  to  specific 
curriculum  issues  and  teacher  variables. 
School  Structure 

Considering  the  concern  with  making  teaching  more  professional  by 
altering  the  workplace  conditions  of  schooling,  funding  agencies  and 
school  districts  should  invest  in  experiments  at  the  school  level  ir:  which 
the  structural  conditions  of  teaching  are  altered.    Schools  selected  for 
participation  in  such  research  must  demonstrate  that  their  teachers  and 
administrators  have  already  developed  norms  for  professional 
collaboration  among  teachers  (e.g.,  exchange  information,  gather  relevant 
data  and  other  information,  put  new  insight  into  practice).    By  studying 
such  schools,  researchers  could  determine  what  teachers  who  work  as 
professionals  can  accomplish.    For  example,  it  might  be  useful  to  examine 
what  would  happen  if  teachers  reallocated  20%  of  the  time  they  spend 
instructing  students  to  "other  activities.    In  such  restructuring 
experiments,  it  would  be  important  to  determine  how  teachers  reallocate 
time  (read  more,  phone  more  parents,  talk  with  peers,  conduct  action 
research,  observe  other  teachers,  build  curriculum  units)  and  how  changes 
in  time  utilization  affect  students'  performance  and  motivation.  Could 
schools  be  redesigned  so  that  students  spent  more  of  their  time  in 
constructive  group  work  and  individual  activities?    Students  in  such 
schools  might  have  the  opportunity  for  more  labwork  and  independent  study. 
Curriculum  units  in  these  schools  might  be  better  integrated,  emphasizing 
concepts  rather  than  isolated  facts.    Reciprocally,  one  could  argue  that 
new  structures  and  related  opportunities  might  not  be  used  to  motivate  and 
to  extend  student  thinking  but  rather  to  supervise  and  to  control  students 
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sin'  -  the  learning  activities  would  be  less  teacher-directed,  at  least  for 
some  portions  of  the  day.    To  reiterate,  because  the  process  of 
restructuring  is  of  critical  importance,  it  is  important  to  verify  that 
teachers  in  schools  participating  in  the  funded  experiments  have  already 
exhibited  the  capacity  for  professional  behavior.   The  issue  to  be 
examined  would  not  be  what  happens  when  schools  are  given  more  funds  but 
rather  what  happens  when  schools  that  allow  teachers  to  function  in 
professional  ways  are  given  adequate  resources  to  expand  teachers'  role  as 
professionals. 

Power  (1989),  drawing  upon  a  recently  complete  study  by  the  RAND 
Corporation  notes  that  the  RAND  Corporation  had  been  successful  in 
identifying  a  list  of  contract  statements  that  helped  to  distinguish 
reform-minded  faculties  that  were  supporting  teacher  professionalism.  In 
the  study,  roughly  20  differently  contract  provisions  promoting  teacher 
professionalism  were  identified.    Included  among  the  list  were  some  of  the 
following:    1)  duration  of  school  day  is  specified,  2)  teachers  are 
guaranteed  preparation  periods,  3)  maximum  class  sizes  are  specified,  4) 
teachers  paperwork  load  is  limited,  5)  number  of  classroom  interruptions 
are  limited,  6)  salaries  are  paid  during  sabbatical  leave,  7)  teachers 
evaluated  as  unsatisfactory  get  help,  8)  the  number  of  subjects,  grades, 
or  ability  groups  a  teacher  must  teach  is  limited.    Needed  are  clear 
theory  and  good  empirical  data  to  illustrate  how  contracts  and  other 
structural  variations  influence  school  learning. 

Halllnger  (1989)  points  out  that  some  --  perhaps  many      high  school 
principals  would  not  be  able  to  serve  as  instructional  leaders.    He  argues 
that  it  may  be  possible  for  high  school  principals  to  become  effective 
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instructional  leaders  by  developing  teachers'  leadership  capacity. 
However,  in  my  opinion,  ^to  be  an  instructional  leader  a  principal  must 
also  have  a  good  general  knowledge  of  research  on  effective  teachers  and 
schools.   Although  a  principal  cannot  achieve  specialized  knowledge  in  all 
areas,  he/she  should  understand  some  of  the  issues  involved  in  designing 
and  evaluating  teaching-learning  in  complex  subjects.    Still,  the  issue  of 
school  leadership  teams  and  local  decision  making  opens  up  exciting 
possibilities  for  different  types  of  structural  change  and  the  opportunity 
to  examine  how  variations  in  structure  affect  teacher  and  student 
conceptions  of  subject  matter  and  students'  ability  to  use  subject-matter 
knowledge  in  responding  to  problems  that  involve  critical  thinking. 

As  Colvin  (1989)  notes,  schools  are  beginning  to  experiment  with  new 
lines  of  authority  and  in  some  cases  allowing  principals  and  teachers  Jo 
make  choices  about  allocating  resources.   To  do  this,  however,  schools 
must  be  able  to  estimate  how  much  a  given  teacher's  time  is  worth  and  how 
that  time  should  be  allocated.    What  schools  need  are  conceptual  and 
empirical  analyses  that  examine  alternative  ways  to  use  school  personnel. 
Do  we  hire  master  teachers  or  more  teachers? 

There  is  a  paucity  of  information  to  describe  how  large  school 
districts  function  and  especially  missing  is  information  about  effective 
functioning.    Hill,  Wise,  and  Shapiro  (1989)  argue  that  an  urban  school 
district  can  improve  only  if  the  entire  community  is  working  toward  the 
improvement  of  the  school  district.    In  their  study  of  six  school 
districts  (Atlanta,  Cincinnati,  Memphis,  Miami,  Pittsburgh,  and  San  Diego) 
report  that  four  general  conditions  were  necessary  for  improving  schools. 
They  noted  that  these  school  districts  improved  in  part  because  they  were 

ERIC  lly 


71 

able  to  encourage  the  larger  community  to  become  involved  in  educational 
issues  and  also  because  they  made  information  about  school  needs  and 
resources        and  student  performance  broadly  available.    Further,  they 
created  community-wide  agreement  about  the  need  to  achieve  certain 
educational  goals  and  further,  they  were  able  to  successfully  subordinate 
the  traditional  role  of  school  boards,  teachers,  and  administrators  to  the 
broad  mandate  of  a  system-wide  improvement  effort. 

Needed  also  are  better  understandings  of  why  some  school  districts 
are  better  able  to  respond  to  the  needs  of  initiatives  of  individual 
schools  than  are  other  school  districts.    Along  these  lines,  it  would  be 
instructive  to  see  how  central  office  staffs  make  decisions  about  staff 
development  across  the  district  and  how  these  programs  actually  relate  to 
the  interests  that  teachers  in  individual  schools  have.    We  spend  large 
amounts  of  dollars  a  year  on  staff  development;  however,  the  evidence  for 
either  global  or  differential  effectiveness  is  uncertain  (Stringfield, 
persoial  communication).    It  seems  important  to  begin  to  examine  how  the 
various  funds  that  are  utilized  by  districts  on  workshops,  new  equipment, 
curriculum  supplements,  and  so  forth  actually  influence  students' 
opportunities  in  the  classroom.    Are  there  more  effective  ways  that  school 
resources  could  be  spent? 

Reseanii  hur;dina  and  the  Roles  of  Regional  Laboratories 

The  major  task  that  I  was  asked  to  undertake  in  writing  this  paper 
was  to  comment  upon  important  ways  to  expand  the  extant  knowledge  base 
about  teaching  and  schooling.    However,  I  was  also  asked  to  share  a  few 
thoughts  about  the  present  and  continuing  funding  of  educational  research 
and  the  roles  of  regional  laboratories. 
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Research  and  development  centers  can  be  a  substantial  force  for 
helping  educators  to  become  more  knowledgeable  about  productive  learning 
in  school  settings.    Regional  laboratories  can  play  a  significant  role  by 
helping  school  districts  to  understand  research  and  to  use  it 
appropriately.    Laboratories  can  also  assist  school  districts  in 
conducting  action  research.    However,  I  believe  that  we  also  need  to 
stimulate  diverse  lines  of  inquiry  by  making  more  funds  available  to 
individuals  to  conduct  research. 
Funding 

I  believe  in  a  balanced  approach  to  research  and  development  that 
stresses  research  and  development  centers,  regional  laboratories,  and 
individually-initiated  field  research.    In  my  judgment,  all  three  of 
these  areas  are  woefully  underfunded  by  OERI.  Individually-initiated 
field  research  is  particularly  underfunded,  probably  because  individual 
researchers  and  single  institutions  simply  do  noi  have  the  political 
constituency  and  political  power  needed  to  argue  successfully  for  money 
when  funds  are  scarce. 

Considering  the  complexity  of  successful  teaching/learning  in  complex 
social  situations,  it  is  vital  to  broaden  the  base  of  research  scholars  to 
the  fullest  extent  possible.    Investments  in  100  different  investigators 
might  eventually  lead  to  the  development  of  10  substantial  lines  of 
inquiry  that  could  then  be  systematically  pursued  in  organized  research 
and  development  centers.    Ultimately,  the  products  of  this  knowledge  could 
be  effectively  disseminated  by  regional  laboratory  personnel.  The 
existence  of  a  large  number  of  investigators  challenges  the  status  quo  in 
appropriate  ways  and  generates  more  comprehensive  studies  than  is  possible 
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than  when  funding  is  limited  to  a  small  number  of  institutions  with  a 
fixed  agenda. 

Because  the  extant  knowledge  base  about  schooling  is  so  limited,  I 
encourage  the  expenditure  of  new  funds  in  order  to  maximize  the  potential 
for  gaining  new  knowledge.    As  I  have  indicated,  i  think  the  budget  of 
OERI  should  oe  increased  by  at  least  600%.    I  would  argue  that  50%  of  new 
funds  ought  to  be  designated  for  field-initiated  research  in  order  to 
build  an  infrastructure  for  research  and  development.    The  larger  the 
number  of  researchers,  and  the  broader  their  backgrounds,  the  healthier 
the  field  will  be  in  the  long  run.    I  want  to  stress  that  r.iy  suggestions 
do  not  challenge  the  funds  currently  allocated  to  labs  and  centers;  I  am 
talking  about  new  funds  that  come  into  the  budget.    Of  the  remaining  50% 
of  the  new  funds,  35%  or  sc  should  go  into  research  and  development 
centers,  and  roughly  15%  Of  new  funds  above  current  levels  into  regional 
laboratories.    After  a  decade  of  successful  funding  for  research  activity, 
one  might  want  to  reverse  these  figures  so  that  proportionally  more  money 
Is  spent  on  dissemination.    It  currently  seems  .most  important  to  stimulate 
new  research  activities.    If  regional  laboratories  are  to  be  restricted  to 
a  dissemination  role  (I'm  not  sure  that  this  restrictive  role  is  most 
appropriate;  however,  it  i„  the  role  that  is  presently  assigned), 
proportionally  fewer  of  the  new  dollars  should  be  spent  on  dissemination. 
The  logic  of  this  position  is  simple:    we  need  to  produce  more  knowledge 
that  can  be  disseminated. 
Laboratories'  RcTes 

Disseminaf  ng  results.    It  seems  to  me  that  regional  laboratories  can 
continue  to  play  several  important  roles.    First,  they  can  disseminate 
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findings  and  concepts.    Although  research  appears  to  have  levelled  off  to 
some  extent,  rran>  useful  concepts  have  been  generated  in  the  last  20 
years.    Since  some  of  this  research  knowledge  is  relatively  old,  (e.g. 
Kounin's  groundbreaking  work  on  classroom  management  in  1970),  it  is  easy 
to  assume  that  it  has  been  disseminated.    However,  as  I  work  with 
teachers  in  various  communities,  I  find  that  many  teachers  still  do  not 
have  a  working  vocabulary  for  discussing  important  variables  such  as 
management,  expectations,  or  instructional  systems.    Efforts  to  help 
teachers  understand  key  concepts  for  analyzing  their  teaching  and  that  of 
peers  are  critical.    Regional  laboratories  ought  to  establish  whether  most 
teachers  are  cognizant  of  findings  and  concepts  from  effective  school  and 
classroom  research  (e.g.,  wait  time,  with-it-ness,  alerting,  passivity 
model,  active  teaching,  etc). 

i  think  it  important  that  knowledge  not  be  disseminated  passively. 
That  is,  I  am  not  calling  for  laboratory  personnel  to  produce  documents 
that  describe  the  knowledge  base.    Many  excellent  sources  of  this 
knowledge  are  available      for  example,  the  book  that  Jere  Brophy  and  I 
have  written,  Looking  in  Classrooms,  provides  a  useful  summary  of  research 
concepts  and  knowledge  in  various  areas,  including  student  mediation, 
direct  teaching,  mastery  learning,  and  cooperative  learning.  Regional 
laboratories  could  combine  books  such  as  ours  (or  other  published 
sources)  with  new  formats  and  learning  materials  that  help  teachers  to 
become  more  effec  ;\e  consumers  of  research. 

There  are  currently  too  many  overlapping,  redundant  articles  and 
reports.    We  now  need  seminars  that  combine  more  active  illustrations  of 
knowledge,  such  as  videotapes  of  classroom  teaching  (or  videotapes  of 
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students  learning  cooperatively  in  learning  groups,  etc.),  and  written 
materials  that  teachers  could  study  in  advance.    This  would  enable 
teachers  to  use  concepts  as  they  analyze  teaching  and  make  suggestions 
about  improving  their  own  teaching  and  that  of  peers.    The  emphasis  would 
be  on  helping  teachers  develop  a  working  knowledge  of  existing  technical 
concepts  that  they  could  use  to  analyze  teaching.    At  the  same  time, 
teachers  would  learn  that  research  does  not  yield  prescriptions      it  only 
provides  analytical  concepts  and  findings  that  teachers  can  use  to  think 
about  teaching  in  a  particular  context.   Teachers  would  be  encouraged  to 
consider  the  quality  of  teaching  and  intended  outcomes.  Unfortunately, 
too  many  evaluation  systems  focus  narrowly  on  the  format  of  teaching  and 
ignore  quality  (i.e.,  the  reasonableness  of  the  examples  that  are  chosen 
and  the  appropriateness^of  the  subject  matter).   This  occurs,  I  believe, 
because  basic  research  findings  have  been  inadequately  disseminated. 
Regional  laboratory  projects  that  involve  teachers  in  the  critical 
analysis  of  teaching  merit  funding. 

Publicizing  new  findings.    Regional  laboratories  also  should  expose 
teachers  to  some  of  the  new  findings  from  subject  matter  research  and 
student  mediation  research.    This  research  is  still  in  its  infancy,  and 
there  is  little  detailed  information  about  how  teachers' 
conceptualizations  of  subject  matter  influence  students'  views  of  subject 
matter  or  the  ways  in  which  they  will  ultimately  use  it.    Still,  teachers 
should  be  introduced  to  this  literature  (e.g.,  Carpenter  et  al.,  1988; 
Shulman,  1986;  Smith  &  Neale,  1989)  and  discuss  issues  such  as  teachers' 
knowledge  of  content,  teachers'  pedagogical  content  knowledge,  and 
appropriate  strategies  for  teaching  content  and/or  identifying  key 
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subject-matter  concepts  and  student  misconception;.    Such  discussions 
could  sensitize  teachers  to  a  broader  range  of  constructs  that  they  could 
use  as  they  think  about  and  plan  instruction. 

Helping  principals  become  instructional  leaders.  Regional 
laboratories  could  also  prepare  principals  to  play  instructional 
leadership  roles.    It  appears  that  many  principals  inappropriately  use 
knowledge  about  teaching  (e.g.,  Brophy,  1988;  Good  &  Mulryan,  in  press) 
and  that  much  could  be  done  to  help  principals  to  become  more  effective 
instructional  leaders.    In  too  many  cases  principals  still  remain 
relatively  uninformed  of  recent  advances  in  motivation,  instructional 
delivery,  student  mediation,  and  classroom  management  (e.g.,  see  Good  & 
Brophy,  1987).    Principals  could  use  this  information  to  help  teachers 
become  aware  of  alternative  instructional  practices  and  plan  classroom 
activities  that  allow  more  active  and  successful  student  learning.  Some 
principals  have  interpreted  research  on  teaching  too  literally  and  have 
used  it  to  make  rules  for  how  teachers  ought  to  behave  in  the  classroom. 
Here  the  misplaced  emphasis  is  upon  the  form  rather  than  the  quality  of 
instruction. 

Developing  educators'  research  skills.    Because  research  must  be 
interpreted  and  applied  in  a  given  context,  principals  and  teachers  should 
learn  to  conduct  their  own  research.   Teachers  and  principals  need  to  gain 
knowledge  about  research  skills  that  would  be  of  most  use  in  their 
particular  settings.    Unfortunately,  few  teachers  possess  the  detailed 
knowledge  and  technical  skills  necessary  for  conducting  research.  They 
would  likely  benefit  from  seminars  and  programs  that  help  them  develop 
skills  for  collecting  observational  data,  understanding  single-subject 
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research  designs,  and  help  them  become  more  systematic  in  their  efforts 
to  understand  their  students'  performance. 

Too  often  training  programs  emphasize  quantity      the  number  of 
teachers  who  are  exposed  to  ideas  in  a  given  period  of  time.  However, 
any  program  attempting  to  develop  teachers'  research  skills  should  focus 
on  the  development  of  skills  in  a  few  select  teachers  over  a  long  period 
of  time.    That  is,  a  highly  successful  program  might  involve  25  to  30 
teachers  who  are  released  for  a  period  of  10  days  per  year  over  a  3-year 
period.   Teachers  would  develop  important  research  skills,  use  those 
skills  to  conduct  research,  and  then  disseminate  their  research  results  to 
other  practitioners.    This  procedure  would  establish  a  group  of  teachers 
who  could  help  other  teachers  develop  research  dispositions  and 
opportunities.    Few  teachers  may  become  active  researchers;  however,  it 
seems  important  to  enhance  research  skills  of  interested  teachers. 
Teachers  have  rich  classroom  expertise  that  is  often  ignored  in  the 
research.    Efforts  to  make  teachers  more  knowledgeable  and  skillful  in 
conducting  research  would  pay  off  in  the  long  run  by  combining  research 
expertise  and  clinical  experience. 

Breaking  down  teacher  isolation.    Regional  laboratories  could  allow 
teachers  to  share  ideas  and  resources  around  an  organized  agenda  through 
the  formation  of  teacher  jtudy  groups,  curriculum  groups,  or  observational 
groups.    Since  few  teachers  have  the  opportunity  to  interact  on  a 
professional  basis  with  other  teachers,  state-wide  or  local  study  groups 
that  take  on  significant  educational  problems  could  be  an  extremely 
meaningful  activity.    The  format  and  nature  of  these  groups  could  take 
many  forms;  however,  they  should  consist  of  teachers  who  have  similar 
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interests  and  allow  teachers  access  to  relevant  literature  and  resources, 
and  time  to  read,  to  think,  and  to  integrate  the  extant  knowledge  base 
with  their  experience.    Teachers  could  develop  specific  strategies  and 
more  integrative  curricula. 

Analyzing  curriculum.    There  is  growing  recognition  that  the  school 
curriculum  involves  too  much  memorization  of  facts  and  learning  of 
discrete  topics.    There  is  growing  interest  in  helping  students  to  develop 
more  formalized  and  integrated  knowledge  of  key  concepts  rather  than 
covering  numerous  concepts  superficially.    The  opportunity  for  teachers, 
administrators,  citizens,  professors  of  education,  and  professors  of  arts 
and  science  to  participate  on  task  forces  is  an  important  potential 
investment.    In  my  opinion,  the  attempt  to  study  curriculum  on  a  broad 
scale  often  results  in  a  frustrating  inability  to  change  anything  simply 
because  too  much  is  attempted  at  once.    However,  if  strategic  areas  were 
selected  (e.g.,  science  in  first-,  second-,  and  third-grade  classrooms) 
and  if  creative  individuals  studied  a  curriculum  area  for  an  extended 
time,  better  analyses  of  the  curriculum  problem  and  better  solutions  could 
emerge.     Although  curriculum  decisions  necessarily  should  be  made  by 
local  districts,  investments  by  regional  laboratories  --  in  organizing 
debates  and  analytical  summaries  --  throughout  a  region  or  state  so  that 
districts  have  more  information  and  conceptualization  to  draw  upon,  could 
be  a  creative  and  important  part  of  innovation  in  American  education. 
Obviously,  summaries  and  syntheses  that  are  developed  would  have  to  be 
subjected  to  research  and  development  activities;  however,  since  these 
proposals  are  derived  from  local  districts,  at  least  some  of  the  field- 
initiated  research  might  be  able  to  respond  to  these  emerging 
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opportunities.    That  is,  as  new  curriculum  reforms  and  new  structures  in 
schools  emerge,  they  should  be  validated  through  careful  research. 

Examining  use  of  research  in  schools.    Although  I  believe  that 
laboratories  can  and  should  build  model  dissemination  efforts  and  develop 
research  skills  of  school  district  personnel,  the  sheer  number  of  school, 
districts  almost  guarantees  that  much  laboratory  work  will  necessarily 
involve  leadership  development  for  state  government  officials  and  central- 
office  district  personnel.    Still,  dissemination  must  be  a  primary 
activity  for  laboratories.    The  development  of  viable  dissemination 
strategies  requires  firsthand  knowledge  of  how  principals  and  teachers 
interpret  and  utilize  information  from  research.    Further,  if  much  of  the 
activity  focuses  on  helping  district  officials  to  develop  leadership 
skills,  then  it  will  also  be  necessary  to  evaluate  the  extent  to  which 
research  helps  teachers  to  provide  more  thoughtful  and  creative 
instruction.    Too  much  dissemination  has  been  done  without  considering  the 
effects  of  information  on  classroom  behavior,  for  example,  on  students' 
thinking  and  problem  solving.    Dissemination  cannot  consist  of  relatively 
passive  distribution  of  information  but  must  help  teachers  creatively 
conceptualize  and  extent  the  curriculum  and  instruction  that  they 
consider. 

Increasing  communication  between  labs  and  centers.    Although  I  am 
sure  that  there  is  informal  contact  between  various  laboratories  and 
research  and  development  centers,  I  know  of  no  formal  mechanism  by  which 
they  discuss  common  problems  (e.g.,  special  dissemination  issues 
associated  with  a  particular  research  topic  --  or,  reciprocally,  pressing 
concerns  about  which  practitioners  need  information?).    Considering  that 
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centers  and  laboratories  share  overlapping  concerns      producing  and 
sharing  research  knowledge  with  educators      more  public  informal 
communication  between  these  institutions  might  have  productive  effects  on 
schooling.    We  need  more  systematic  information  about  dissemination  and 
conceptualizations  of  dissemination  strategies  that  present  knowledge  in 
ways  that  enhance  rather  than  constrain  individual  teachers'  performance. 
Shared  work  by  centers  and  laboratories  might  move  this  important  agenda 
forward . 

Intelligent  Use  of  Research:    A  Final  Note 
Finally,  it  must  be  kept  in  mind  that  the  role  of  research  is  not  to 
provide  simple  solutions  for  educators,  although  one  important  task  of 
research  is  to  evaluate  the  effectiveness  of  various  models  for  improving 
student  thinking. and  motivation.    Clearly,  some  instructional  models  will 
work  for  particular  learners  under  certain  conditions  and  others  will  not. 
The  more  teachers  know  about  models  and  the  limits  of  particular  models, 
the  more  flexibility  they  will  have  for  meeting  the  needs  of  individual 
learners.    The  task  of  research  is  to  broaden  --  not  to  narrow  -- 
teachers'  conceptions  of  practice.    Hence,  the  value  of  research  cannot 
depend  on  its  ability  to  control  practice  but  rather  is  related  to  the 
ability  of  research  to  help  teachers  comprehend  classroom  instructional 
problems  and  to  respond  to  problems  they  confront.    In  this  sense, 
research  yields  theory  for  "framing"  problems  and  planning  possible 
action,  for  broadening  the  range  of  student  outcomes  possible,  for 
building  technical  skills  and  vocabulary  necessary  for  discussing 
schooling  with  other  teachers  and  educators,  as  well  as  providing 
practical  information  about  the  effects  of  particular  instructional 
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learning  strategies  under  well -specified  conditions.    The  "needed 
research"  described  in  this  document  is  advanced  in  the  spirit  of 
broadening  possibilities  of  practice  in  order  to  make  teaching  more 
reflective.    Even  research  conducted  by  participants  in  a  given  school 
district  will  apply  unevenly  to  other  participants  in  a  school  district. 
It  must  be  understood  that  research  yields  information  and  concepts  that 
have  applied  in  view  of  particular  values  and  specific  classroom  contexts. 

Our  conceptions  of  what  research  is  --  and  could  be  --  have  been  too 
narrow  and  driven  by  immediate  considerations.    To  improve  the  usefulness 
of  research,  a  substantial  increase  in  state  and  local  funding  is  needed. 
Further,  researchers  must  turn  to  long-term  agendas,  focus  on  both  basic 
and  applied  knowledge,  and  broaden  their  understandings  of  what  research 
can  yield  for  practitioners  who  work  in  demanding  and  complex  social 
settings.    As  researchers  attempt  to  more  carefully  study  classrooms,  they 
must  solicit  the  assistance  of  teachers  and  principals  in  conceptualizing 
educational  problems  and  developing  models  to  respond  to  those  problems. 
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Policy  Paper  on  the  Program  of 
Regional  Educational  Laboratories 

the  perspective  of  a  former  chief  state  school  officer 

David  W.  Hornbeck 

To  place  what  follows  in  context,  the  reader 
should  know  that  I  served  for  twelve  years  as  the  chief 
state  school  officer  in  Maryland,  an  additional  five 
years  as  the  deputy  chief  state  school  officer  in 
Pennsylvania,  a  board  member  on  the  Council  of  Chief 
State  School  Officers  for  seven  years,  and  its 
President  for  one.    Thus,  I  come  to  this  task  of 
rendering  a  chief  state  school  officer's  perspective  on 
Regional  educational  Laboratories  with  the  virtue  of 
substantial  breadth  and  depth  of  experience.  (I 
recognize  some  will  conclude  this  virtue  is  in  fact 
vice  in  the  form  of  bias.) 

The  perspective  I  provide  is  my  own.    still,  in 
shaping  that  perspective  for  this  paper,  I  consulted 
with  ten  incumbent  chief  state  school  officers  plus  two 
other  former  colleagues.     I  included  at  least  one  chief 
state  school  officer  from  each  of  the  nine  laboratory 
regions,     in  at  least  three  instances  the  person 
consulted  serves,  or  has  served,  as  the  chairman  of  the 
lab  boa^d. 
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As  a  backdrop  to  the  recommendations  I  will 
offer, there  are  three  contextual  facts  that  should  be 
highlighted. 

The  first  is  the  increasingly  prominent  role  and 
responsibility  of  the  state  in  the  definition  and 
delivery  of  elementary/secondary  education  in  the 
United  states.    While  that  fundamental  responsibility 
for  public  schools  has  always  rested  with  the  states 
and  is  evident  in  the  constitutions  of  the  states,  it 
was  declared  to  be  a  state  responsibility  in  an 
unusually  forceful  way  by  the  U.  s.  Supreme  Court  in 
the  Rodriguez  case  arising  from  Texas.    While  not 
solely  derivative  of  the  Rodriguez  decision,  the  state 
role  in  public  school  policy  making  continued  to  grow 
during  the  70' s.    it  was  expanded  most  significantly  in 
the  1980s.    Governors,  chief  state  school  officers, 
state  boards  of  education  and  state  legislatures  seized 
the  initiative,  setting  the  education  agenda  for  the 
nation,  increasing  the  funding  level  very  substantially 
in  many  states  and  enacting  unprecedented  laws  and 
regulations  in  an  effort  to  improve  education  quality. 

At  the  same  time,  this  strong  state  role  was 
encouraged  at  the  national  level  by  an  Executive  branch 
of  government  which  clearly  wanted  the    states  to 
assume  both  the  policy  and  financial  responsibility  for 
public  education.    This  was  evident  in  the 
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philosophical  position  articulated  forcefully  by  the 
President  and  the  Department  of  Education.     It  was  also 
clear  in  the  repeated  attempts  early  in  the  decade  to 
reduce  federal  funding  significantly.    The  same  theme 
has  been  played  in  a  different  way  in  the  Congress 
where  very  significant  responsibility  has  been  lodged 
with  the  states  in  many  legislative  initiatives, 
including  most  prominently  P.L.  94-142  and,  most 
recently,  in  the  significant  program  improvement 
provisions  of  the  Chapter  I  reauthorization. 

The  fact  is  that  law,  practice,  and  fiscal  policy, 
make  the  state  the  leadership  level  of  government  in 
public  education.    Or,  as  it  has  been  put,  Public 
Education  is  to  state  Government  what  National  Security 
is  to  the  Federal  Government,  its  central 
responsibility. 

The  second  contextual  fact  I  wish  to  highlight  is 
that    historically,  public  education  has  been  governed, 
planned  for,  administered,  and  funded  based  on  in-put 
criteria.    We  are  in  the  midst  of  a  major  change  across 
the  nation  toward  output  criteria  becoming  increasingly 
important.  ^ 

The  evidence  for  this  shift  is  reflected  in  the 
emphasis  on  testing  that  has  emerged  since  the  mid-70s. 
This  emphasis  was  made  clear  initially  by  a  commitment 
in  more  than  thirty  states  to  competency-based  testing, 


frequently  associated  in  some  manner  with  the  promotion 
and/or  graduation  of  students.    A  few  years  later,  in 
an  effort  to  improve  the  quality  of  teachers,  nearly 
all  states  turned  to  teacher  testing  as  an  objective, 
outcome-based  way  of  measuring  product.    Five  years 
ago,  the  Council  of  Chief  State  School  Officers,  in  an 
unprecedented  move, (and  by  an  initial  margin  of  one 
vote)  endorsed  the  idea  of  state  by  state  comparisons 
based  on  Aest  data.    They  then  launched  a  major 
assessment  initiative  to  try  to  assure  that  such 
comparisons  are  done  with  integrity  using  instruments 
and  focusing  on  subject  areas  within  a  time  frame  that 
makes  sense.    That  idea  was  enhanced  by  the 
Alexander/James  Commission  recommendations  that  state 
by  state  comparisons  be  supported  by  the  federal 
government  because  sound  educational  data  revealing 
inter-state  as  well  as  national  school  performance  is 
necessary  to  the  nation's  health  and  well  being. 

The  frequent  calls  for  vouchers  or  choice  plans 
also  have  a  strong  outcome-based  flavor  to  them.  That 
flavor  was  made  explicit  last  year  in  a  model  statute 
developed  by  the  Council  of  Chief  State  School  Officers 
which  provided  that  at-risk  students  have  an 
enforceable  right  to  attend  a  "successful"  school. 
Successful  was  defined  in  outcome  terms.    The  model 
statute  provided  that  where  a  school  remained 
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unsuccessful,  at-ri  k  students  were  provided  the  right 
to  move  to  another  (and  successful)  school  at  the 
school  system's  expense.     (I  should  emphasize  that  the 
Chiefs1  model  statute  was  not  a  choice  for  choice's 
sake  plan.    A  form  of  choice  within  the  Chiefs1  model 
statute  became  an  option  only  when  the  child's  school 
did  not  produce  a  decent  education.)    The  point, 
however,  is  not  the  statute.    The  point  is  the  emphasis 
on  outcomes. 

The  final  evidence  of  this  increasing  emphasis  on 
outcomes  which  I  wish  to  offer  is  the  current 
rhetorical  focus  on  empowering  teachers,  principals, 
and  others  at  the  local  school  building  level  to  make 
more  of  the  important  educational  decisions.  While 
some  remain  committed  to  empowerment  as  an  end  in 
itself,  it  is  clear  that  implicit  in  the  concept  is 
increased  accountability,  and  that  accountability  must 
be  defined  in  outcome  terms. 

The  third  contextual  fact  I  wish  to  highlight  is 
the  changing  workforce  requirements  of  the  economy. 
This  fact  has  three  components.    First,  the  nation  has 
a  declining  number  of  young  people.    Second,  an 
increasing  proportion  of  those  youth  are  minority, 
poor,  and/or  do  not  speak  English  as  a  first  language. 
Schools  fail  to  educate  well  a  disproportionate  number 
of  those  students.    Third,  the  nature  of  our  economy 
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requires  that  a  much  broader  array  of  new  workers  have 
higher  order  skills  than  has  been  necessary  before.  Of 
the  27  million  net  job  growth  between  1972  and  1986, 
only  three  million  have  required  only  a  traditional 
basic  skill  level  education.    Moreover,  it  is  estimated 
that  youth  entering  the  job  market  today  will  change 
jobs  six  times  and  occupations  three  times.    Such  job 
and  occupational  mobility  will  clearly  require  a  much 
higher  set  of  learning  skills.    The  capacity  to  think, 
to  learn  to  learn,  will  for  the  first  time  be  an 
economic  necessity  for  a  broad  base  of  our  citizenry, 
not  a  special  reality  for  a  small  group  of  those  we 
deem  gifted. 

These  three  contextual  facts  represent  the 
backdrop  against  which  I  make  the  following 
recommendations  concerning  the  regional  educational 
labs: 

First,  I  recommend  that  the  federal  government 
declare  a  bold  clear  objective  toward  which  federal 
human  resources  research  and  development  funds  in 
general  and  education  research  and  development 
initiatives  in  particular  are  directed,     in  the  history 
of  education  or  human  resources  research  and 
development,    we  have  never  had  a  driving,  powerful 
objective  that  is  analogous  to  putting  a  man  on  the 
moon  or  eradicating  smallpox  or  developing  the  atomic 
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bomb.  The  economic  circumstances  of  the  nation  alluded 
to  earlier  make  it  imperative  that  we  establish  such  an 
objective. 

In  November,  1987,  the  Council  of  Chief  state 
School  Officers  unanimously  approved  a  policy  statement 
entitled,  "Assuring  School  Success  for  Students  at 
Risk."    That  statement  provided  the  challenge  when  it 
states,  "An  imperative  for  America's  21st  century  is 
high  school  graduation  for  virtually  all  students." 

Such  a  mission  should  become  the  organizing 
principle  for  the  work  of  the  labs.    Indeed,  I  would 
argue  that  the  mission  should  be  the  organizing 
principle  for  a  systematic  federal  human  resources 
research  and  development  initiative.    The  labs, 
centers,  technical  assistance  centers,  and 
clearinghouses  should  clearly  be  a  part  of  such  a  bold 
undertaking.    However,  it  should  extend  further.  The 
research  and  development  work  as  well  as  data 
collection,  for  example,  associated  with  the  Labor 
Department's  Jobs  Training  Partnership  Act  activities 
should  be  a  part  of  this  effort.    A  higher  level  of 
common  definitions  and  common  standards  to  define 
drop-outs,  reading  levels,  math  skills,  and  other  data 
elements  should  be  adopted.    Affirmative  initiatives 
should  be  undertaken  to  transfer  research  knowledge 
from  the  National  Aeronautics  and  Space  Agency  and  the 


Department  of  Defense  to  the  practical  use  of  those 
seeking  to  increase  the  human  resources  reservoir  of 
the  nation.    If  there  were  an  organized,  systematic 
process  for  the  transfer  of  technology  knowledge,  it 
could  enhance  the  public  school  learning  environment  in 
many  ways.     Finally,  I  recommend  as  a  part  of  this 
overall  strategy  that  policies  and  incentives  be 
developed  to  encourage  the  transfer  of  knowledge 
related  to  human  resource  development  in  the  private 
sector  research  and  development  world  to  the  public 
sector.    On  the  one  hand,  I  should  think  that  some 
measure  of  technology  transfer  would  be  possible 
without  offending  the  proprietary  interests  of  the 
private  sector.    At  the  same  time,  it  is  estimated  that 
more  than  $50  billion  is  spent  each  year  in  the 
so-called  "corporate  classroom."    The  strategies  of 
th«c  "classroom"  may  be  directly  applicable  in  the 
public  classroom.    The  transfer  of  that  kr^wledge, 
those  strategies,  could  be  very  helpful,     m  doing  so, 
of  course,  the  private  sector  would  receive  a 
considerable  return.     Increasing  the  productivity  of 
the  public  classroom  will  reduce  the  cost  of  the 
corporate  classroom. 

If  such  a  bold  mission  were  declared,  it  would 
give  focus  to  all  the  questions  of  research.    We  would 
systematically  examine  various  reasons  for  differences 
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ir  graduation  rates  at  different  high  schools  or  in 
different  school  systems.    To  what  degree  are  resources 
the  critical  variable?    Teacher  qualities  and 
qualification?    School  governance?  Classroom 
organization?    The  availability  of  technology?  The 
nature  of  the  .curriculum  or  pedagogy?    We  could 
methodically  examine  .a*  impact  of  parent  involvement. 
At  home.    In  school.     In  various  roles. 
Differentconfigurations  of  time  could  be  scrutinized. 
To  what  degree  must  we  lengthen  the  school  day?  The 
school  year?    For  all  your/jsterr?    Only  for  some?  Most 
importantly,  such  inquiries    would  be  focused  and 
connected.    Each  would  have  thr  ultimate  objective  of 
virtual  100%  high  school  graduation  as  the  organizing 
principle.    This    fact,  in  turn,  would  make  it  feasible 
to  connect  othe.  *-i3e  disparate  strands  of  research  more 
powerfully,     in  many  instances  the  impact  would  be  much 
greater  than  the  arithmetic  sum  of  the  parts,     it  would 
benefit  in  a  geometric  sense  from  the  synergistic 
impact  of  such  focused  efforts. 

If  w»»  were  to  embark  on  such  a  bold  mission  for 
human  resources  related  research  and  development,  what 
role  for  the  regional  educational  labs?    I  envision 
their  playing  a  role  not  unlike  the  vision  of  their 
present  one.    They  would  represent  the  primary 
connective  point  between  the  research  being  done  in  the 
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broader  range  of  institutions  suggested  above  and  the 
elementary/secondary  school  delivery  system.  They 
would  help  define  the  research  questions.    They  would 
serve  as  a  conduit  for  the  collection  and  dissemination 
of  data.    They  would  continue  applied  research 
activities. 

The  fr 11 owing  are  illustrations  of  the  connective 
roles  I  envision  for  the  labs.    A  lab  could  identify 
the  six  or  eight  corporate  entities  in  a  region  that 
have  the  most  sophisticated  employee  training  programs 
and  form  a  committee  of  the  corporate  training 
directors  who  could  perform  at  least  two  roles.  First, 
they  could  identify  what  strategies  their  training 
programs  use  which  could  be  introduced  into  elementary, 
secondary,  or  adult  education  programs  run  by  the 
public  school  systems.    The  corporate  model  may  use 
technology  more  efficiently,  for  example,  for  secondary 
or  adult  basic  skill  development.    Their  methods  may 
accomplish  specific  objectives  (outcome  oriented) ,  in 
fewer  days  but  done  more  intensely  (change  in  the 
structure  of  time) ,  using  different  physical  settings 
(change  in  where  learning  takes  place) ,  monitored  in 
part  by  a  technician  (change  in  who  delivers 
instruction) ,  employing  new  hardwire  and  software 
(change  in  how  instruction  is  delivered) . 
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A  second  type  of  role  for  t*»  lab-connected 
corporate  training  directors  committee  would  be  to 
identify  what  training  programs  are  being  run  in 
corporate  settings  to  develop  skills  which  schools 
could  or  should  have  addressed  as  part  of  their  basic 
mission.    This  connection  could  lead  then  to  a  deeper 
understanding  by  schools  of  how  they  must  equip  all 
young  people  for  the  jobs  that  will  exist. 

A  second  basic  illustration  of  the  connective  role 
could  involve  a  representative  of  each  lab  working  with 
one  or  more  representatives  of  the  Council  of  Chief 
State  School  Officers  in  collaboration  with  high  level 
personnel  in  the  Department  of  Defense.     Defense,  of 
course,  has  a  huge  engagement  in  education.    They  bring 
to  bear  a  technological  capacity  to  the  problems  of 
learning  unparalleled  in  the  public  school  world.  A 
Defense/Regional  Lab/Chief  state  School  Officer 
collaboration  with  appropriate  support  -ouid  send  the 
product  of  such  an  effort  back  through  the 
communication  tracks  of  the  labs  into  state  education 
agencies  for  use  in  the  schools. 

A  third  illustration  in  which  the  lab's  connective 
role  can  be  demonstrated  would  be  to  have  jaore  formal 
communication  between  centers  and  labs.    This  has  been 
a  goal  for  labs  and  centers,  but  largely  unrealized.  I 
suggest  two  formal  connections.    Representatives  of  all 
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labs  and  all  centers  should  meet  for  a  structured 
exchange  once  a  year.    That  could,  perhaps,  occur  in 
conjunction  with  or  as  a  sub-part  of  the  annual 
American  Education  Research  Association  meeting.  A 
second  formal  connection  that  should  be  considered  is 
to  have  each  lab  director  serve  on  the  advisory  board 
of  a  center  and  to  have  each  center  director  serve  on 
the  board  of  a  lab. 

The  lab  is  obviously  the  constant  in  all  of  these 
illustrations.    The  lab  is  the  funnel  with  which  much 
is  poured  from  diverse  research  sources.    The  lab  is 
then  the  primary  connective  point  to  the  schools.  The 
lab  will  interpret  the  schools'  needs  to  the  source  of 
research  and  will  translate  the  products  of  research  to 
the  schools. 

Those  involved  in  schools  must  play  a  major,  if 
not  decisive,  role  in  these  matters.    They  know  the 
barriers  they  face.    They  know  the  learning  obstacles 
of  children.    After  research  based  answers  are 
identified,  they  will  not  be  implemented  without  school 
and  school  system  commitment.    The  movement  of 
questions,  answers,  information,  and  data  into  school 
and  out  of  schools  must  be  organized  and  systematic. 
That  movement  should  be  orchestrated  by  the  labs  under 
the  direction  of  the  chief  state  school  officers  from 
each  region. 
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The  second  broad  recommendation  I  offer  could  be  a 
sub-part  to  the  first,  since  it  also  involves  focusing 
research  and  development  activities.    Our  overall 
mission  is  graduation  for  all.    However,  specific 
attention  is  necessary  to  the  content  of  what  that 
means.    Recommendation  one  points  to  the  need  to 
evaluate  different  answers  to  four  questions:  how 
(instructional  strategies)  do  we  teach  all 
successfully?    At  what  time  during  the  day  or  year 
(when)  must  we  teach  for  all  students  to  be  successful? 
Where  are  the  best  settings  for  successful  teaching  and 
learning?    Who  is  best  suited  to  teach  under  various 
circumstances  in  various  places  at  different  times  if 
we  are  to  be  successful?    But  a  different  order  of 
inquiry  is  reflected  in  the  question  of  what  we  should 
teach  and  how  all  of  those  other  questions  are 
connected  to  the  answer.    I  offer  this  recommendation 
independently  of  the  first  in  order  to  give  it 
tap has is. 

For  a  number  of  years,  the  skill  level  reflected 
in  "grade  level  performance"  on  nationally  normed  tests 
has  tended  to  become  our  goal.  It  has  become  almost  an 
annual  ritual  for  superintendents  across  the  country  to 
wait  with  some  degree  of  anxiety  for  the  release  of  the 
results  of  that  year's  administration  of  the  California 
Achievement  Test  or  the  Iowa  Test  of  Basic  Skills  or 
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other  tests  judged  by  the  public  to  contain  the 
standard  by  which  their  schools  are  to  be  measured. 
The  same  phenomenon  is  played  out  up  and  down  the 
school  hierarchy.    Frequently,  in  many  school  systems, 
the  implicit,  if  not  explicit,  goal  is  to  have  the 
school  system's  average  performance  meet  the  national 
norm.    The  inadequacy  of  that  goal  is  the  point  I  wish 
to  make.    In  the  first  place,  the  idea  of  either  a  norm 
or  average  means  that  a  substantial  number  of 
individual    students  do  not  meet  it.    Thus,  by 
definition,  for  a  school  to  pursue  the  norm  is  to  have 
a  goal  other  than  success  for  all. 

However,  the  second  weakness  of  the  goal  of  a 
school  achieving  on  average  the  national  norm  at  a 
given  grade  level  is  the  norm  itself.    Even  if  one  were 
to  translate  the  norm  point  into  a  criterion  referenced 
point,  to  achieve  it  will  be  to  achieve  too  little.  I 
refer  back  to  the  contextual  fact  dealing  with  the 
economy.    A  nation  in  pursuit  of  a  level  of 
intellectual  development  reflected  in  the  present  norms 
on  the  various  nationally  normed  tests  is  a  nation  in 
pursuit  of  long  term  mediocrity.    First,  as  has  been 
stated,  if  that's  the  goal  and  all  achieve  it,  we  will 
have  achieved  too  little.    Second,  however,  we  will 
face  the  spectre  of  middle  to  upper  class  groups  of 
young  p-sople  achieving  the  higher  order  skills 
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necessary  to  a  vibrant  American  economy  in  the  21st 
century.    At  the  same  time,  after  a  frenzy  of  activity 
on  behalf  of  "at-risk"  youth,  they  will  achieve  the 
norm  level  expectations,  only  to  discover  that  the  gap 
between  them  and  their  more  well-to-do  peers  has 
widened.    That  will  be  devastating  for  them  and  for  the 
rest  of  us  who  rely  on  an  economy  requiring  higher 
order  skills  by  a  much  larger  proportion  of  the  student 
population  than  those  circumstances  will  produce. 
The  point  is  made  by  examining  the  National 
Assessment  of  Educational  Progress  data.     In  the  1986 
Writing  Report  Card,  NAEP  reports,  for  example,  that 
fewer  than  one- third  of  the  students  assessed  could,  on 
any  persuasive  task,  write  a  response  judged  adequate 
or  better.    Even  in  the  11th  grade,  only  28%  wrote 
adequate  or  elaborated  responses  to  the  least  difficult 
persuasive  tasks.     In  science,  in  the  1988  Report  Card, 
NAEP  found  that  at  age  17,  while  there  had  been 
improvement,  student  science  achievement  was  still 
below  that  of  1969.    And  on  a  recent  mathematics  report 
card,  while  average  performance  has  improved,  the 
gains,  NAEP  finds,  are  largely  confined  to  lower  order 
skills.    The  nation  and  its  schools  face  a  very  large 
challenge. 

If  we  are  to  establish  a  bold  mission  of 
graduating  virtually  100%  of  our  youth  from  high 

,  -  15  - 

UM£  is? 


school,  it  is  important  that  the  content  of  achieving 
that  goal  is  substantive.    Thus,  in  addition  to 
examining  the  how,  when,  where,  and  who  questions,  a 
centerpiece  mission  of  the  research  and  development 
associated  with  increasing  our  productive  human 
resources  must  also  be  the  what  of  education.    I  do  not 
argue  that  the  labs  themselves  should  be  the  source  of 
curriculum  definition  and  development.    However,  I  do 
recommend  that  such  work  be  systematically  pursued.  The 
public  school  curricula  must  be  built  on  the  best 
thinking  available  in  the  sciences,  math,  the 
humanities.    Appropriate  content  related  to 
citizenship,  principles  of  democracy,  values  and 
religion  requires  careful  consideration.  Health 
education  and  appropriate  content  for  promoting 
physical  and  mental  fitness  needsre-examination. 

Higher  expectations  should  be  reflected  in  the 
curriculum  itself.    The  content  should  be 
developmentally  appropriate  and  developmentally 
interesting  to  students.    Today,  our  practice  tends 
toward  breadth  rather  than  depth  of  coverage.     In  a 
u  ild  faced  with  information  overload  on  the  one  hand 
and  the  necessity  of  thinking  and  the  exercise  of  good 
judgment  on  the  other,  we  need  to  seriously  reconsider 
our  orientation  toward  breadth  of  coverage. 
Thought fulness  is  a  greater  attribute.  Understanding, 
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not  coverage,  should  be  the  goal.    Related  to  that 
consideration  is  the  importance  of  integrating  core 
elements  of  the  curriculum.    Discrete  bits  of 
information  and  unconnected  subject  matter  is  often 
relatively  meaningless.    We  should  consider  the 
potentially  greater  power  toward  the  development  of 
higher  order    skills  by  presenting  curriculum  in  the 
framework  of  broader  themes. 

There  is  an  additional  factor  which  is  strongly 
related  to  the  contextual  facts  set  forth;  the  call  for 
the  bold  objective  for  the  human  resources  research  and 
development  community  of  universal  graduation;  and  the 
requirements  of  quality  curricular  content.  That 
factor  is  the  need  for  increasingly  rich  assessment 
instruments,  techniques,  and  procedures. 
Accountability  to  a  demanding  public  is  both 
appropriate  and  required.    Any  strong  accountability 
initiative  will  shape  what  occurs  in  schools.  More 
specifically,  it  will  lead  to  an  effort  to  "teach  to 
the  test."    That  is  good,  not  bad.    it  simply  means 
that  we  must  make  every  possible  effort  to  ensure  that 
what  the  assessment  measures  is  worth  learning  and  that 
how  the  assessment  is  conducted  at  least  does  not 
interfere  with  what  is  learned  (better  yet  if  the 
assessment  techniques  actually  enhance  the  learning) . 
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To  provide  the  nation's  schools  with  a  curricular 
base  covering  the  content  areas  necessary  to  an 
informed  citizenry  and  productive  workforce  in  an 
integrated,  developmental ly  appropriate  manner  with 
intrinsically  high  expectations  and  to  be  able  to 
measure  the  product  of  learning  will  require  a  very 
significant  research  foundation  that  does  not  presently 
exist.    That  foundation  will  include  the  research 
related  to  the  curriculum  content  itself.     But  it  must 
then  be  connected  to  how  it  is  taught,  where  the  best 
learning  occurs,  the  timeframe  in  which  different 
students  can  best  learn  it,  and  who  is  most  effective 
in  deliverying  it.    Again,  the  labs  provide  a  critical 
connection  to  the  world  of  practice.    We  can  neither 
ask  the  right  questions,  formulate  responsive  answers, 
or  seek  to  validate  them  without  a  systematic, 
^comprehensive,  realistic  connection  of  the  research 
community  to  the  school  community.    As  suggested 
earlier  the  labs  can  provide  that  connection  if  they 
are  coherently  designed  and  governed  to  do  so. 

I  wish  to  make  one  specific  implementation 
recommendation  related  to  broad  recommendations  one  and 
two.    Across  the  United  states  on  a  daily  basis  two 
million  teachers  are  at  work  in  hundreds  of  thousands 
of  schools  in  sixteen  thousand  school  systems.  Many 
are  successfully  teaching  and  their  students  are 
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successfully  learning.    To  date,  we  have  not  discovered 
\n  effective  mechanism  for  identifying  successful 
instructional  practices  measured  by  defensible 
standards,  which  can  then  be  disseminated  in  a 
non-cumbersome  and  useful  manner.    The  result  is  that 
we  either  lose  valuable  insight  into  effective  practice 
and  know-how  or  we  subject  it  to  such  convoluted 
validation  processes  that  others  are  unable  to  learn 
about  them.    Yet,  the  notion  of  "effective  schooling" 
or  "what  works"  has  achieved  at  least  rhetorical 
prominence  across  the  nation.    We  even  find  it  in 
legislation.    For  example,  chapter  I  requires  school 
systems  applying  for  funds  to  guarantee  their  SEA  that 
their  programs  are  "of  sufficient  size,  scope,  and 
quality  to  give  reasonable  promise  of  substantial 
progress  toward  meeting  the  educational  needs  of  the 
children  being  served."      Labs  could  support  such 
requirements  not  only  by  identifying  programs  that 
would  meet  high  quality  standards,  but  also  by 
designing  evaluation  techniques  and  studies  which 
school  systems,  schools,  and  teachers  could  use  to 
demonstrate  that  home  grown  programs  work,     it  is 
fashionable  to  call  for  the  empowerment  of  teachers  and 
principals.    That  call  should  be  supported.    One  way  to 
do  so  would  be  to  give  teachers  the  tools  to  evaluate 
their  efforts  and  to  share  successful  efforts  with 
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others  through  means  sufficiently  simple  so  as  to  be 
realistic. 

I  do  not  suggest  that  the  labs  can  connect 
directly  in  a  significant  way  with  individual  school 
systems,  much  less  with  individual  schools  or 
classrooms.    However,  through  the  state  education 
agency,  outreach  into  and  out  of  local  education 
agencies  is  possible  and  desirable. 

The  third  broad  recommendation  I  offer  is  that 
adecisive  role  in  the  governance  of  the  labs  be 
exercised  by  the  chief  state  school  officers  in  each 
region.    If  labs  are  to  exist,  and  I  believe  they 
should,  someone,  not  everybody,  iul  t  make  the  basic 
policy  decisions.    I  reach  that  conclusion  for  the 
following  reasons. 

First,  if  we  are  going  to  have  any  chance  of 
achieving  our  objective  of  100%  graduation,  there  must 
be  a  focal  point  of  leadership.    Major  bold  objectives 
of  the  kind  called  for  are  never  achieved  when  one 
operates  on  a  lowest  common  denominator  decision  by 
committee  basis.    Thus,  a  governance  structure  composed 
of  representatives  from  the  ranks  of  school 
administrators,  teachers,  university  faculty,  business, 
and  the  state  department  of  education  will  not  function 
effectively  unless  there  is  a  decisive  source  of  "buck 
stopping"  policy  decision  making.    Someone,  or  some  one 
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group    must  bear  that  responsibility  albeit  in 
consultation  with  others. 

Second,  it  is  important  for  chief  state  school 
officers  to  develop  a  vested  interest  in  lab  results. 
If  the  chief  state  school  officer  is  not  in  a  position 
of  meaningful  leadership  in  laboratory  decision  making, 
or  worse,  if  the  chief  feels  "shut  out"  (a  situation 
that  exists  in  more  than  one  region,  involving  more 
than  one  state)  it  is  not  likely  the  chief  will  take 
the  work  of  the  lab  very  seriously,  however  brilliant 
that  work  may  be. 

Third,  those  who  are  accountable  must  also  have 
the  authority  to  act.     It  is  clear  that  state  laws, 
including  the  constitutions  of  the  states,  practice, 
and  public  perception  view  the  state  as  the  guarantor 
of  public  education.    As  noted  earlier,  state 
leadership  has  seized  the  elementary/secondary 
initiative  in  policy  and  fiscal  terms  during  the  past 
two  decades,    state  level  education  leadership  has 
demonstrated  its    willingness  to  be  held  accountable, 
even  to  have  the  product  of  state  educational  efforts 
compared  from  state  to  state.    At  the  same  time,  that 
leadership  needs  the  tools  of  achievement  at  its 
disposal . 

One  of  the  tools  that  will  prove  most  helpful  is 
research-based  insight  into  policy  options  which  must 
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be  considered.    No  state,  either  in  its  state 
department  of  education  nor  in  its  universities,  has 
the  research  capacity  to  do  the  job,  to  answer  either 
the  strategy  questions  of  how,  where,  when,  and  who  or 
the  content  question — what — with  a  solid  research 
basis. 

Fourth,  the  chief  state  school  officers  of  each 
region  should  be  the  arbiters  of  lab  policy  in  each 
region  in  contrast  to  other  state  leaders.    Some  may 
argue  that  the  Governors  of  the  several  states  in  a 
region  should  decide  who  will  be  the  state  standard 
bearer.    That  would  be  a  mistake.    The  labs  are  to  be 
the  connective  tissue  between  the  research  generated  by 
several  sources  and  the  schools.    The  Governor  is  not 
in  a  position  to  have  substantive  knowledge  about  these 
issues.    Nor  is  the  Governor  in  a  direct  relationship 
to  school  systems  and  schools,  and  thus,  cannot 
effectively  oversee  movement  into  and  out  of  schools  as 
research  is  conducted  and  results  are  disseminated. 
The  connective  tissue  role  is  not  basically  a  political 
one  in  the  electoral  sense,    it  is  a  complex 
educational  one  involving  a  major,  even  a  dominant, 
state  role  but  a  state  role  that  must  be  played  out 
against  a  practice  in  most  states  of  local  control. 
The  office  of  the  chief  state  school  officer  in  each 
state  is  the  office  that  most  often  relates  to  the 


state  political  apparatus  and,  at  the  same  time  the 
local  school  board;  teachers  and  administrators,  as 
well  as  the  organizations  that  represent  chem;  parents 
through  the  PTA;  the  business  community;  and  the 
university  community. 

My  recommendations  arise  in  part  from 
conversations  with  twelve  other  incumbent  or  former 
chief  state  school  officers  consulted  in  the 
preparation  of  this  paper.    The  underlying  question 
asked  of  each  was,  "What  contribution  has  your  regional 
educational  lab  made  to  educational  and/or  school 
reform  in  your  state?"    The  answer  from  each  depended 
upon  the  degree  to  which  the  chief  state  school  officer 
perceived  that  the  state  education  agencv  could  rely  on 
lab  support  for  SEA-defined  priorities.    In  each 
instance  in  which  there  was  generally  positive  feedback 
(five  of  eight,  with  one  other  in  a  wait  and  see 
posture  due  to  changes  in  the  lab  recently)  the  lab 
prioritier.  were  regional  as  well  as  rooted  in 
'  .lividual  state  priorities.    Each  sitting  or  former 
chief  state  school  officer  underline  ,  the  fact  that  he 
or  she  was  not  looking  for  support  just  for  his  or  her 
own  state.    Each  noted  that  to  serve  regional 
priorities  is  to  serve  each  individual  state  if  the 
chiefs  have  had  a  palpable  role  in  selecting  the 
priorities. 
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In  contrast,  it  does  not  work  from  the  perspective 
of  a  chief  state  school  officer  if  the  lab  director  and 
staff  operates  in  the  mode  of  a  university  department 
with  lab  staff  as  a  whole  or  even  individual  lab  staff 
effectively  choosing  priorities  which  may  suit  their 
research  interests  but  not  necessarily  the  needs  of  the 
people  and  institutions  the  labs  are  designed  to  serve. 
Neither  does  it  function  well  if  each  constituency 
sitting  un  the  board  of  a  lab  is  the  co-equal  object  of 
lab  service.     If  chiefs  get  their  share  and  teachers 
theirs,  ana  administrators  theirs,  and  so  on,  all  may 
have  been  kept  arguably  happy,  but  the  cumulative, 
focused  impact  of  the  research  will  have  been 
significantly  dissipated.    Dissipation  of  effort  is  one 
characteristic  the  labs  can  ill-afford  since  their 
resources  are  so  meager  in  the  context  of  the  size  of 
their  task.    That  fact  underlines  the  importance  of 
maximizing  the  focus  of  the  work  of  the  labs  in  the 
manner  suggested — by  declaring  a  mission-like 
objective,  defining  the  content  or  major  directions 
important  to  that  mission,  and  putting  the  chief  state 
school  officer  in  charge  f *om  a  policy  perspective. 

The  structure  and  method  of  operation  presently 
employed  by  Research  for  Better  Schools  (RBS)  is  a  good 
example  of  how  r  /vernance  and  implementation  of  the 
labs  can  work  reasonably  well. 
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Research  for  Better  Schools,  located  in 
Philadelphia,  Pennsylvania,  presently  serves  five 
jurisdictions;  Pennsylvania,  New  Jersey,  Delaware,  the 
District  of  Columbia,  and  Maryland.    Maryland  has  been 
a  formal  part  of  the  RBS  system  since  1985  when  the  new 
contracts  were  let.    However,  two  years  prior  to  that 
Maryland  was  invited  to  send  observers  to  Board 
meetings  and  was  the  recipient  of  a  small  amount  of 
service. 

The  Board  of  Directors  is  an  active  Board,  meeting 
quarterly.    Between  meetings  the  Executive  Committee 
meets  monthly.    The  Board  consists  of  twenty  members. 
The  five  chief  state  school  officers  or  their  designees 
are  members.    Each  chief  chooses  three  other  members 
from  his  or  her  jurisdiction.    Those  selected  are  to 
represent  diverse  communities  including  boards  of 
education,  teachers,  administrators,  and  the  broader 
community.    But  it  is  the  chief  state  school  officer 
who  effectively  makes  the  decision  as  to  who  serves  as 
a  board  member  from  his  or  her  state. 

RBS  serves  regional  priorities,  supports  state 
initiatives,  and  to  a  limited  extent,  after 
consultation  with  the  state  leadership,  renders  service 
directly  to  local  school  systems. 

An  important  contribution,  for  example,  at  the 
regional  level  is  a  staff  development  desicn  for  middle 
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management.    The  five  jurisdictions  all  recognized  that 
their  middle  managers1  effectiveness  was  crucial  to 
their  success.    They  also  recognized  that  frequently 
individuals  rising  to  the  level  of  middle  management 
had  little  or  no  relevant  management  experience.  These 
issues  became  even  more  important  in  the  context  of 
increasing  expectations  of  state  performance,  a 
reflection  of  a  higher  measure  of  accountability. 

The  focus  of  the  middle  management  staff 
development  initiative  is  at  the  bZk  level.    RBS  staff 
meets  with  staff  in  each  state  in  a  pre-retreat 
conversation  of  preparation.    A  two-day  retreat  is  then 
held;  and,  subsequently,  there  are  follow-up  activities 
with  staff  in  each  state.    Over  a  period  of  time,  this 
process  is  repeated  for  each  of  several  areas  of  focus, 
including:         planning,  b)  managing  people,  and  c) 
facilitating  versus  imposing  change.    Given  SEA  staff 
turnover,  t\j  states  and  RBS  expect  to  repeat  the  cycle 
every  two  to  three  years. 

Other  regional  activities  include  projects  to 
determine:    a)  how  testing  impacts  on  schools  and 
students  in  the  context  of  several  variables,  b) 
relative  success  with  early  childhood  education 
initiatives,  and  c)  gains  in  student  achievement  in  a 
number  of  different  program  areas. 
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At  the  present  time,  the  bulk  of  RBS  activity  is 
directed  toward  priorities  within  each  state, 
identified  by  each  state.    Each  state  is  assigned  a 
coordinator  by  RBS.    That  person  plus  his/her  superior 
meet  each  year  on  behalf  of  RBS  with  the  SEA's 
representatives  to  negotiate  the  areas  and  activities 
of  emphasis  for  the  subsequent  year,     in  the  case  of 
Maryland,  the  two  third-ranking  persons  in  the 
Department,  the  Assistant  Deputy  state  Superintendents, 
represent  the  Department.    Prior  to  meeting  with  the 
RBS  staff  for  this  purpose  each  year,  the  two  Assistant 
Deputies  consult  with  the  Maryland  state  Department  of 
Education  (MSDE)  Cabinet  and  those  more  directly 
responsible  for  vocational,  general,  special,  and 
compensatory  education.    They  would  also,  of  course, 
consult  with  the  state  Superintendent.  These 
conversations  were  always  conducted  within  the  context 
of  formal  priority  setting  and  resource  allocation  at 
the  Department.    Not  surprisingly,  RBS  activity  is  in 
direct  support  of  the  primary  reform  efforts  underway 
in  Maryland. 

For  several  years,  including  those  when  Maryland 
participated  only  informally  m  the  life  of  RBS,  a 
focus  was  Project  Basic,  Maryland's  very  broad-based 
competency  education  program.    Project  Basic  impacts  on 
every  Maryland  student,  culminating  at  the  high  school 
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level    in  a  requirement  that  each  student  pass  four 
tests  (reading,  writing,  mathematics,  and  citizenship) 
as  a  pre-requisite  for  graduation.    RBS  assisted  in  the 
implementation  design — how  do  you  actually  get  the 
program  to  impact  at  the  school/classroom  level?  The 
MSDE  assigned  one  staff  person  full-time  to  each  school 
system  to  assist  in  the  implementation  of  Project 
Basic.    RBS  evaluated  the  effectiveness  of  such  a 
facilitation  model.    Central  to  Project  Basic's  success 
has  been  the  requirement  that  a  school  system  provide 
"appropriate  assistance"  to  any  student  not  passing  the 
required  tests  the  first  they  are  given  in  the  ninth 
grade.    RBS  and  MSDE  program  staff  designed  various 
models  of  appropriate  assistance.    Project  Basic,  after 
twelve  years  of  development  and  implementation,  is  now 
an  on-going  part  of  Maryland's  education  program. 

A  second  major  commitment  in  Maryland  several 
years  ago  was  to  bring  to  local  school  systems  the  very 
best  research-based  instructional  strategies.    We  have 
done  that  through  a  program  called  School  Improvement 
Through  Instructional  Processes  (SITIP) .  To 
oversimplify,  approximately  two  dozen  candidates  for 
selection  as  one  of  the  four  best  instructional 
strategies  were  identified.    A  variety  of  means  were 
then  used  to  reduce  the  number  to  the  final  four. 
School  systems  were  invited  to  send  a  team  to  hear 
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about  the  four  with  the  understanding  that  each  system 
would  agree  to  faithfully  try  at  least  one.    within  two 
years,  all  systems  had  chosen  at  least  one.  Hundreds 
of  classrooms  are  involved.    There  ave  extensive  staff 
development  activities  associated  with  the  effort  using 
primarily  atrainer  of  trainers  model,    over  the  years, 
additional  SITIP  options  have  been  made  available. 
Research  for  Better  Schools  has  been  a  significant 
resource  to  this  process,  including,  most  recently, 
conducting  a  process  evaluation  of  the  model. 

Maryland,  as  has  happened  in  nearly  every  other 
state,  has  examined  extensively  the  role  and  character 
of  secondary  education  in  the  state.    This  examination 
began  with  a  blue  ribbon  high  school  commission  from 
which  emanated  dozens  of  recommendations  ultimately 
receiving  the  imprimatur  of  the  state  Board  of 
Education.    Early  in  the  process  five  high  schools 
reflecting  widely  divergent  student  populations  were 
selected  to  serve  as  contexts  to  test  various  policy 
options  and  in  which  we  intended  to  focus  subsequent 
evaluation  activities.    RBS  helped  Maryland  design  the 
process  through  which  Maryland  is  determining  the 
impact  of  the  Commission's  recommendations.    RBS  is 
also  involved  in  carrying  through  the  evaluation. 

More  than  a  decade  ago,  the  education  community 
concluded  the  principal  was  one  of,  if  not  the,  most 
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important  job  in  the  education  hierarchy,    with  a  good 
principal,  one  was  quite  likely  to  have  a  good  school; 
similarly,  a  poor  principal  was  likely  to  yield  an 
equally  self-fulfilling  prophecy  in  the  school. 
Maryland  was  one  of  the  first  states  to  provide  an 
extensive  Principal's  Academy  (the  Maryland 
Professional  Development  Academy) .    RBS  is  now  engaged 
in  helping  the  MSDE  determine  the  impact  of  the  Academy 
programs.    Do  schools  demonstrably  change?  Does 
student  achievement  improve?    Are  results  evident  after 
one  year?    Two?    What  changes  in  the  Academy  program 
are  called  for  to  improve  its  impact  on  school  (and 
student)  performance? 

A  substantial  percentage  of  new  teachers  leave 
teaching  within  five  years.    At  a  time  when  good 
teachers  are  at  a  premium,  schools  cannot  tolerate  that 
turn-over,    one  of  the  underlying  causes  many  believe 
is  the  insensitive  way  in  which  we  permit  new  teachers 
to  come  to  the  classroom.    New  teachers  are  given  full 
teaching  loads  with  little  or  no  staff  development 
support.    Help  and  encouragement  from  other  human 
beings,  including  experienced  teachers,  is  the  product 
of  the  other  teacher's  initiative  or  the  new  teacher's 
good  fortune  more  frequently  than  planfulness. 
Maryland  has  embarked  on  a  major  effort  to  implement  a 
beginning  teacher  induction  process  that  will  avoid 

•  .  -  30  - 

ERJC  170 


these  mistakes.    RBS  is  a  full  partner  in  evaluating 
that  effort. 

Eighteen  months  ago,  Maryland's  Governor  launched 
two  significant  education  initiatives,    one  was  the 
Governor's  Commission  on  School  Performance.  Its 
mission  is  to  recommend  to  the  state  Board  and  the 
Governor  what  indicators  can  most  sensitively  tell  us  a 
school  is  successfully  performing  its  mission  with  all 
its  students  and  what  assessment  strategies  can  yield 
data  best  for  those  indicators.    The  second  initiative 
was  the  Rural  Schools  Enhancement  Project.  The 
superintendents  in  Maryland's  six  poorest  systems 
agreed  to  set  several  performance  objectives , 
including:    a)  lowering  the  drop-out  rate  to  10%;  b) 
increasing  daily  attendance  to  95%;  c)  having  90%  of 
their  ninth  graders  pass  the  competency  tests  in 
reading,  writing,  math,  and  citizenship  the  first  time 
they  are  given.    A  variety  of  activities  are  part  of 
the  project.    RBS  is  providing  important  support  to 
both  of  the  Governor's  initiatives. 

Finally,  the  Maryland  state  Department  of 
Education's  most  important  priority  is  to  identify 
governance,  curriculum,  instructional  and  staffing 
strategies  that  will  work  more  effectively  for  children 
and  youth  at  risk  of  school  failure.    For  the  past  two 
years,  most  of  the  MSDE's  activities  have  been  crafted 
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in  terms  of  how  they  related  to  that  priority.    RBS  has 
again  played  a  major  role.    They  have  conducted  and 
maintained  a  survey  of  the  literature  to  help  ensure 
that  Maryland  does  not  miss  what  others  have  learned; 
they  have  worked  with  both  LEAs  and  the  SEA  to 
summarize  present  activities,  since  one  of  the  majcr 
challencf»s  is  to  use  present  resources  most 
effectively;  they  drafted  a  major  plan  of  action  for 
the  Maryland  state  Board  of  Education  related  to 
serving  Maryland's  at-risk  student  population. 

A  centerpiece  of  Maryland's  at-risk  initiative  is 
Maryland's  Task  Force  on  At-Risk  Children  and  Youth. 
Maryland  was  one  of  eleven  states  to  receive  a  grant 
from  the  Council  of  chief  State  School  Officers  (funded 
by  the  Department  of  Labor)  to  design  a  piece  of 
legislation  which  would  guarantee  children  and  youth  at 
risk  of  school  failure  the  education  and  related 
services  reasonably  calculated  to  lead  to  high  school 
graduation.    Research  for  Better  Schools  is  providing 
important  support  to  that  effort. 

I  have  described  Maryland's  experience  with 
Research  for  Better  Schools  at  some  length  because  I 
think  the  way  in  which  RBS/Maryland  operates  represents 
a  model  through  which  the  generic  recommendations  I 
have  made  could  be  implemented  successfully.  The 
RBS/MSDE  major  elements  are:    a)  student  achievement  as 
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a  clear  focus;  b)  priorities  with  improved  instruction 
as  central;  c)  chief  staff  school  officers  in  charge. 

However,  replicating  the  RBS/Maryland  experience 
alone  will  not  do  the  job.    In  setting  our  course  we 
did  not  have  any  sense  of  national  mission.    The  RFP 
for  the  last  round  of  contracts  identified  certain 
school  and  classroom  improvement  goals.    But  no  sense 
of  priority  or  urgency  was  attached  to  them. 

That  sense  of  urgency  is  necessary  in  a  national 
context.    The  requirements  of  the  next  RFP  must  provide 
that  direction.     It  can  do  so  by  a)  requiring  plans  to 
relate  to  the  recommended  mission  of  a  virtual  100% 
graduation  rate  by  the  turn  of  the  century;  b) 
requiring  plans  that  support  the  idea  that  graduation 
have  a  connotation  of  a  rigorous  course  of  study;  c) 
requiring  plans  that  demonstrate  th^  importance  of 
assessment  of  performance  with  rich  procedures 
consistent  with  sound  instruction;  d)  requiring  plans 
that  demonstrate  an  intention  to  help  states  measure 
education  success  or  failure  based  on  outcomes. 

The  next  RFP  should  require  that  the  chief  state 
school  officers  be  in  a  decisive  position.  Boards 
should  consist  of  a  variety  of  constituencies,  but  the 
chief  state  school  officer  should  select  those  from 
among  whom  board  members  are  chosen  or  otherwise 
control  the  selection  process. 


The  next  RFP  should  require  that  the  "connective 
tissue"  role  is  understood.    Applicants  should  be  asked 
to  illustrat  »  how  they  expect  to  serve  in  that  role. 
Some  premium  should  be  attached  to  how  well  and  how 
imaginatively  an  applicant  anticipates  meeting  this 
need. 

American  elementary/secondary  education  is  at*  a 
crossroads.     It  has  performed  exceedingly  well 
historically  in  meeting  the  economic/civic  requirements 
of  the  nation.    From  the  perspective  of  those 
requirements,  we  have  had  the  luxury  or  disposable 
children.    We  did  not  need  all  to  succeed.  The 
equation  has  changed.    We  need  ail  and  we  need 
achievement  at  an  unprecedented  high  level.  The 
Regional  Educational  Labs  cannot  do  that  job  alone. 
But  the  role  I  have  recommended  in  this  paper  is  a 
necessary  one  which,  if  performed  in  the  suggested 
manner,  will  make  a  significant  contribution. 
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REGIONAL  EDUCATIONAL  LABORATORIES: 


HISTORY  AND  PROSPECT1 
by 

James  W.  Guthrie 
University  of  California,  Berkeley 


This  paper  describes  the  hopes  held  for  regional  educational  laboratories  at  the  time  of  their 
founding,  analyzes  the  conditions  that  subsequently  have  come  to  impede  their 
effectiveness,  and  proposes  alternative  operational  strategies  for  shaping  their  future. 

INTRODUCTION 

In  the  time  since  1966,  the  federal  government  has  allocated  $422  million  to  establish  and 
support  a  network  of  Regional  Educational  Laboratories.  Despite  this  substantial 
investment  of  time  and  resources,  the  productivity  of  these  organizations  har  consistently 
been  curtailed  by  unrealistic  operating  assumptions,  uncertain  financing,  and  unstable 
performance  expectations. 

Even  with  surli  handicaps,  or  perhaps  motivated  by  them,  the  nine  remaining  regional 
laboratories  have  curried  crucial  congressional  support,  and  they  ait  unlikely  to  disappear. 
Thus,  the  challenge  is  to  enhance  their  effectiveness,  construct  a  compelling  mission  for 
them,  and  secure  sufficient  operating  stability  to  provide  an  opportunity  for  them  to  become 
an  integral  component  of  the  nation's  future  education  system. 

This  paper  analyzes  the  historic  development  and  contemporary  operation  of  Regional 
Educational  Laboratories  in  an  effort  to  understand  their  strengths  and  weaknesses.  The 
purpose  of  such  an  undertaking  is  to  propose  new  strategies  that  do  not  simply  sidestep 


1 A  paper  commissioned  by  the  United  States  Department  of  Education,  January  1989.  The  author  wishes 
to  expiv is  his  appreciation  to  Norman  Boyan,  Christopher  Cross,  Emerson  Elliott,  John  Evans,  Francis 
Ianni,  Francis  Keppel  Michael  Kim,  Hendrik  Gideonse,  Charles  Stalford,  and  Emily  Wurtz  for  the 
information  they  contributed  and  for  their  constructive  criticisms.  All  interpretations  and  ipeommendations 
are  the  complete  responsibility  of  the  author. 
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past  problems,  but,  marc  forcefully,  enable  these  organizations  to  chart  a  productive  future 
course. 

The  paper  contain  three  maior  sections.  The  first  describes  the  evolution  of  the  Regional 
Educational  Laboratories,  paying  critical  attention  to  the  governmental  planning  and 
political  forces  accompanying  their  formation.  This  analysis  proceeds  by  describing  the 
major  changes  in  policy  and  operation  that  subsequently  have  shaped  die  laboratory 
system. 

The  second  section  describes  the  assumptions  underlying  formation  of  the  laboratories  and 
analyses  die  performance  expectations  and  structural  conditions  tLat  have  consistently 
curtailed  laboratory  effectiveness. 

The  final  section  of  this  paper  summarizes  fundamental  present  day  laboratory  problems 
tiid  poses  alternative  strategies  for  overcoming  them  in  the  future. 

A  Caveat 

At  least  one  caveat  is  in  order  before  proceeding  with  the  above-described  sections.  This 
essay  examines  only  a  component  of  the  nation's  educational  Research  and  Development 
(R&D)  strategy.  Readers  should  understand,  however,  that  many  of  the  impediments  to 
effective  operation  of  the  Educational  Laboratories  are  generic,  inherent  in  the  federal 
government's  overall  R&D  strategy,  and  cannot  be  overcome  in  a  piecemeal  manner.  The 
federal  government's  educational  research  and  development  strategy  was  constructed 
twenty-five  years  ago.  It  has  not  been  systematically  revisited  since.  Many  of  the 
assumptions  underlying  that  strategy  have  changed  significantly.  Changes  arc  called  for 
and  certainly  can  be  made  that  would  render  Education  Laboratories  more  effective. 
However,  it  is  clearly  time  to  assess  existing  arrangements  and  undertake  necessary 
alterations  to  the  entire  R&D  system,  not  simply  the  Regional  Educational  Laboratories. 

Part  One  : 
Inventing  Educational  Laboratories1 


1  Thi«  history  is  interatnfciy  told  by  Stephen  1C  Bailey  and  Edith  M.  Mosher  in  Tlie  ESEA:  The 
Office  of  Eduutfoi    ^infeters  an  Act  (Syracuse:  Syracuse  University  Press,  1966). 
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Education  was  a  strategic  component  of  the  Johnson  administration  "War  on  Poverty"  and 
Educational  Laboratories  were  an  important  element  in  that  strategy.  In  July  of  1964,  in 
order  to  prepare  for  his  anticipated  first  full  term  in  office,  LBJ  formed  a  presidential  task 
force  chaired  by  John  W.  Gardner.  The  charge  to  this  blue  ribbon  panel  was  to  develop  a 
package  of  education  reform  ideas  to  be  submitted  to  Congress  shortly  after  Johnson's 
inauguration.  The  Gardner  Task  Force,  among  its  many  recommendations,  proposed  that 
Educational  Laboratories  be  established  as  a  vital  link  in  die  chain  of  knowledge  generation 
and  diffusion.  The  idea  was  eventually  incorporated  into  Title  IV  of  what  was  to  become 
*e  1965  Elementary  and  Secondary  Eduction  Act  (ESEA).3 

Educational  Laboratories  were  a  logical  component  of  aa  artfully  conceived  ESEA 
legislative  package.  The  ESEA  came  to  be  known  as  education's  first  'Trillion  dollar 
baby'*4  and  Johnson's  political  tacticians5  wanted  to  ensure  that  it  passed  Congress  intact 
and  quickly.  Thus,  the  bill's  five  major  components  were  intended  to  serve  the  nation's 
educational  needs  and  simultaneously  attract  support  from  a  diverse  array  of  political 
factions  whose  historic  inability  to  reach  accord  had  previously  prevented  passage  of  any 
major  education  bill. 

Title  I  was  the  glittering  ESEA  policy  star  with  a  carefully  crafted  entitlement  formula  that 
distributed  federal  funds  to  states  in  a  manner  which  was  educationally  ingratiating  and 
politically  ingenious.  The  congressionally  approved  ESEA  formula  aided  wealthy 
northern,  as  well  as  poor  southern,  states,  but  it  did  so  by  directing  federal  funds  to 
children  from  low-income  households.  The  association  between  household  income  and 
education  level  was  strongly  made  in  congressional  testimony  and,  thus,  die  ESEA  was 
designed  as  a  major  federal  instrument  for  interrupting  the  cycle  of  individual  and 
household  poverty.  The  funds  were  funneled  to  local  school  districts  through  states,  but 
such  was  seen  as  a  mere  technical  formality.  It  was  a  federally  conceived,  federally 
administered,  and  federally  funded  program,  and  no  one  had  any  doubts  about  it. 

ESEA  Title  II  authorized  federal  funds  for  the  purchase  of  textbooks  and  other  instructional 
materials.  Tide  ID  provided  funds  directly  to  local  school  districts  to  enhance  their 
effectiveness  through  development  of  exemplary  and  innovative  projects.  Title  1 V  will  be 


3  Most  of  the  remaining  components  of  which  were  combined  in  1981  into  the  Education  Consolidation 
Improvement  Act 

4  See  thw  article  by  this  name  in  the  June  1966  Atlantic  by  Elizabeth  Benner  Drew. 

5  Namely,  Rrancis  Keppel,  Wilbur  Cohen,  Douglas  Cater,  and  Samuel  Halperin. 
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discussed  further  below.  Tide  V  provided  federal  funds  to  strengthen  state  education 
departments.  This  latter  was  justified  on  grounds  that  ESEA  programs  would  impose 
major  additional  administrative  burdens  upon  states,  and  they  would  have  to  be  buttressed 
if  they  were  effectively  to  assume  their  new  duties. 

Title  IV  amended  the  previously  enacted  (1954)  Cooperative  Education  Research  Act  This 
program  had  funded  education  research  on  a  project-by-project  basis.  Generally,  these 
research  topics  were  proposed  by  professors.  There  was  little  opportunity  for  federal 
officials  to  shape  the  nation's  education  research  agenda.  Moreover,  it  was  difficult  to 
impossible  to  gain  a  critical  mass  of  research  on  a  nationally  significant  topic  or  sustain 
research  in  a  field  once  initiated 

The  new  Cooperative  Education  Research  Act,  ESEA  Title  IV,  authorized  formation  of 
Research  and  Development  Centers  and  Educational  Laboratories.  These  were  envisioned 
as  a  network  or  chain  of  new  institutions  that  would  be  capaole  of  revitalizing  American 
education  by  generating  usef  ul  research  rcsu'ts  and  infusing  them  into  the  nation's 
elementary,  secondary,  and  college  classrooms.  These  various  federally  funded  centers 
and  laboratories  would  compensate  for  the  previously  described  weaknesses  of  agenda 
fragmentation  and  lack  of  research  momentum.  They  would  be  federally  established  and 
federally  funded  However,  they  were  expected  eventually  to  become  self-governing  and 
be  tightly  tied  to  the  needs  of  their  clients,  primarily  school  districts  and  schools. 

Tide  W  was  a  scientific  and  technical  component  of  the  Elementary  and  Secondary 
Education  Act  Titles  I  and  II  were  directly  operational  and  would  immediately  assist  local 
school  districts;  Tide  m  was  an  incentive  or  stimulant  to  local  school  districts  to  become 
more  effective.  Tide  V  was  administrative,  intended  to  ^ttress  die  managerial  capacity  of 
states.  Tide  IV  was  included  to  generate  and  diffuse  new  knowledge  regarding  learning 
and  instruction.  The  initial  recipients  of  Tide  IV  funds  were  the  nation's  researchers. 
Eventually,  however,  it  was  thought  that  research  results  would  benefit  students  in 
schools. 

The  "R  &  D"  strategy  constructed  by  Johnson  administration  education  planners  envisioned 
universities  and  newly  invented  Research  and  Development  Centers  as  residing  close  to  the 
"basic"  or  "pure"  science  end  of  the  research  continuum.  These  institutions  were  to  engage 
in  systematic  inquiry  about  fundamental  components  of  learning  and  instruction.  Research 
and  Development  Centers  were  to  specialize  on  fundamental  dimensions  of  the  education 
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process — reading,  mathematics,  writing,  testing,  evaluation,  and  so  forth.  The  outcomes  of 
the  research  and  development  efforts  then  were  to  be  carefully  shaped  and  conveyed  tc 
school  districts  and  schools  through  "Educational  Laboratories"  These  new  institutions 
were  intended  to  be  unusually  sensitive  to  the  practical  needs  of  administrators  and  teachers 
and  would  be  able  to  interpret  research  results  from  R&D  centers  and  tailor  diem  for  local 
implementation. 

New  education-related  knowledge  was  conceived  as  existing  on  a  continuum  wherein  it 
was  generated  in  R  &  D  institutions  and  subsequendy  implemented  by  end  users  such  as 
schools.  The  shaping  of  R  &  D  results  to  make  them  attractive  and  useful  to  practitioners 
was  to  be  undertaken  by  Educational  Laboratories.  These  new  agencies  were  conceived  to 
be  analogous  to  Agricultural  Extension  Field  Agents  widely  thought  to  be  effective  in 
disseminating  new  growing  techniques  and  products  to  America's  fanners.  Another  model 
were  the  national  laboratories  relied  upon  by  the  Atomic  Energy  Commission  to  translate 
basic  research  findings  of  physicists  into  the  practical  applications  of  atomic  energy 
intended  to  benefit  the  entire  nation.6 

In  order  successfully  to  follow  the  national  physics  laboratory  or  extension  agent  models, 
Educational  Laboratories  would  have  to  recruit  unusually  able  professionals  who  not  only 
could  identify  R&D  ideas  worthy  of  diffusion,  but  who  also  could  gain  and  hold  the 
respect  of  school  practitioners  to  whom  they  would  attempt  to  distribute  ideas  and 
products. 

Educational  Laboratories  were  believed  to  be  crucial  for  such  a  knowledge  dissemination 
and  implementation  function  because  there  were  few  other  similar  organizations  then  in 
existence.  State  Education  Departments,  prior  to  the  implementation  of  ESEA  Tide  V,  were 
notably  weak.  Independent  policy  analysis  centers,  s  jch  as  have  now  evolved  in  twenty* 
two  states,  did  not  exist  National  organizations  capable  of  distributing  information,  such 
as  the  Education  Commission  of  the  States  and  die  National  Governors  Association,  either 
did  not  exist  or  had  little  interest  in  education.  Private  sector  and  not-for-profit  consulting 
firms  were  few  in  number.  In  short,  there  was  little  by  way  of  a  service  infrastructure 
upon  which  American  education  could  depend  for  the  generation,  distribution,  and 
implementation  of  new  knowledge.  Educational  Laboratories  were  intended  to  fill  the  void. 


0  The  Atomic  Energy  Commission  National  Laboratory  idea  wa*  intended  to  convey  the  notion  cJ  fiscal 
magnitude.  These  physical  science  labor&iuries  have  huge  budgets. 
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Trouble:  From  the  Beginning,  And  More 


However  thoughtfully  conceived,  Regional  Educational  Laboratories  were  launched  on  a 
troubled  sea.  Many  of  the  crucial  assumptions  underpinning  their  formation  were 
unrealistic  or  were  soon  to  be  undermined,  and  that  made  it  difficult  for  these  infant 
organizations  to  meet  the  performance  expectations  held  for  diem. 

Second,  an  originally  unintended  element  of  "distributive  politics"  quickly  emerged.  Pork 
barrel  dynamics  became  a  concomitant  element  when  "Regional"  was  added  to  Educational 
Laboratories.  In  the  booming,  buzzing,  chronologically  compressed  confusion  of 
congressional  budget  deliberations,  what  was  to  be  twelve  became  twenty.7  However,  the 
appropriations  level  remained  almost  constant  and  nowhere  near  the  huge  dollar  amounts 
annually  allocated  to  the  archetypes  of  R&D,  the  Atomic  Energy  laboratories.  This  made 
it  difficult  to  shape  and  polish  a  prototype  of  the  newly  conceived  institutions  by 
concentrating  a  critical  mass  of  resources  and  attention  upon  a  relatively  small  number  of 
developing  organizations. 

Third,  because  of  fiscal  decisions,  the  number  of  Educational  Laboratories  was 
subsequently  reduced  to  seventeen,  and  then  to  nine.  No  doubt  sensing  a  similarly  bleak 
financial  future,  some  of  the  remaining  laboratories  began  to  develop  entrepreneurial 
strategies  for  stabilizing  their  budgets.  However  successful  for  a  particular  laboratory, 
these  individual  fund  raising  efforts  were  not  always  consistent  with  the  initially  conceived 
mission  as  knowledge  brokers  serving  local  school  districts. 

Fourth,  the  basic  knowledge  brokering  strategy  was  eventually  altered  in  a  manner  which 
diluted  sensitivity  to  school  district  interests,  injected  a  larger  element  of  organizational 
uncertainty  into  laboratory  operation,  and  impeded  die  ability  to  appraise  laboratory 
performance.  In  1972,  the  management  of  Educational  Laboratories  was  transferred  to  the 
newly  established  National  Institute  of  Education  (NIE).8  In  order  to  exercise  greater 
program  discretion,  NIE  negotiated  a  series  of  five-year  agreements  in  which  laboratory 
projects  were  specified  contractually.  At  this  point,  a  virtually  self-regulating 

7  Confusion  still  exists  regarding  the  number  ot  Laboratories  initially  environed  by  Johnson 
administration  officials.  There  were  advocates  for  a  relatively  snail  number  of  Laboratories  that,  even  if 
regionally  located,  would  serve  a  national  constituency,  not  a  set  of  states.  At  the  opposite  end  of  the 
continuum  were  Office  of  Education  advocates  for  as  many  as  SO  Laboratories,  one  in  each  state. 

^Subsequently  to  be  reincarnated  in  its  current  form  as  the  Office  of  Education  Research  and  Improvement 
(OERI). 
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professionally  propelled  network  of  client-sensitive  knowledge-brokering  institutions  was 
shattered. 


Finally,  the  last  components  of  the  mid  1960s-conceivtd  R&D  plan  were  diluted  with  the 
1985  rehidding  of  the  laboratories.  This  was  die  first  time  in  the  almost  twenty  y^ars  since 
die  laboratories'  formation  that  a  complete  national  competition  would  be  held  There  were 
three  important  outcomes. 


Laboratories  could  uo  longer  assume  that  they  would  last  indefinitely  as  individually 
operating  organizations.  They  could  be  made  to  compete  for  their  continued  existence  and 
their  agenda  could  be  strongly  shaped  by  federal  officials.  Second,  the  number  of 
laboratories  was  reduf  d  to  the  smallest  level  yet,  nine,  wit1 1  many  of  the  remaining 
laboratories  now  having  to  cover  a  larger  geographic  spread  of  constituents.  Third, 
laboratories  were  now  directed  to  devote  a  significant  portion  of  their  budget  to  projects 
operating  "with  and  through"  other  agencies,  such  as  state  education  departments,  in  order 
to  assist  local  school  districts.  This  latter  idea  was  a  realistic  recognition  that  given  existing 
resource  levels,  laboratories  could  not  reasonably  be  expected  to  assist  all  local  school 
districts  in  their  regions.  However,  * Vith  and  through"  was  vastly  different  than  the  direct 
and  client-sensitive  school  district  relationship  that  was  originally  envisioned  for  L 
laboratories. 


Thus,  almost  a  quarter  century  following  their  formation,  Educational  Laboratories  had 
been  transformed  by  economic  and  political  dynamics  from  a  vision  of  a  focused  national 
network  of  federally  supported,  professionally  guided,  elite  status,  knowledge  diffusion 
institutions,  charged  with  developing  close  client  relationships  with  school  districts,  into 
nine,  often  entrepreneurially  oriented,  "job  shops,"  sometimes  only  remotely  related  to 
local  school  districts,  their  agendas  substantially  influenced  by  federal  officials  and 
whatever  clients  they  could  gain  from  marketing  activities,  and  subsisting  financially  from 
competitively  contested  contract  to  contract 


What  had  happened? 

PART  TWO 
Invalid  Assumptions 


Regional  Educational  Laboratories  were  conceived,  and  subsequently  brought  into 
operation,  based  on  at  least  seven  crucial  assumptions  that  have  subsequently  been  difficult 
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to  support  Several  of  the  assumptions  woe  contained  in  authorizing  and  reauthorizing 
statutes,  others  in  the  U.S.  Office  of  Education  and  Department  of  Education  regulations 
and  guidelines  which  were  used  to  shape  the  laboratories  initially  and  reshape  them  ever 
since.  Each  of  these  assumptions  is  described  and  analyzed  below. 

Fulfilling  a  Federal  Agenda 

Regional  Educational  Laboratories  were  conceived  in  an  era  when  die  education  reform 
agenda  was  primarily  federally  initiated  The  "Great  Society"  of  the  Johnson  administration 
assuredly  extended  beyond  education  initiatives,  e.g.,  die  Civil  Rights  Act,  die  Economic 
Opportunity  Act,  and  Model  Cities.  However,  education  reform  was  a  central  feature  of 
the  LB  J  domestic  program.  Perhaps  more  important,  the  ESEA  represented  a  momentous 
symbolic  breakthrough.  To  that  point  in  time,  federal  education  efforts  had  been  severely 
restrained. 

The  1958  Sputnik-inspired  National  Defense  Education  Act  was  precedent-shattering,  but 
not  precedent-setting.  Its  narrowly  conceived  academic  intensification  programs  for  math, 
science,  and  foreign  language  were  not  long-lasting.  Spectacular  American  space 
successes  in  the  1960s  and  1970s  eroded  its  justification,  and  it  had  only  a  minimal  long- 
term  effect  on  school  policy  or  practice.  Vocational  education  was  the  only  education 
dimension  on  which  there  had  been  a  substantial  federal  presence  over  time.  However, 
little  of  significance  had  spread  from  vocational  education  to  the  day-to-day  operation  of 
schools. 

Thus,  the  significance  of  the  ESEA.  It  not  only  authorized  unprecedented  levels  of  federal 
financing,  but  also,  its  substantive  provisions  encompassed  a  wide  spectrum  of  schooling 
purposes  and  reached  multiple  levels  within  America's  schooling  system.  Because  of  its 
political  popularity  and  scope  of  purpose,  proponents  of  a  powerful  federal  role  envisioned 
the  ESEA  as  only  an  opening  salvo  in  a  wider  war  against  educational  inequality  and 
ineffectiveness.  The  1965  ESEA  had  overcome  historic  political  opposition  and 
contributed  to  the  formation  of  an  influential  coalition  of  educationally  predisposed 
interests.  Surely  more  federally  inspired  education  improvement  was  to  come.  The 
enactment  in  1966  of  expanded  federal  roles  for  higher  and  vocational  education  only 
fueled  these  expectations. 
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Savoring  die  experience  of  the  ESEA's  enactment,  die  National  Education  Association 
(NEA)  subsequently  went  on  record  advocating  that  the  federal  government  support  at  least 
a  third  of  the  total  national  costs  of  schooling.  New  schools  needed  to  be  built,  teachers 
deserved  higher  salaries,  racial  segregation  needed  to  be  abolished,  rural  education  needed 
buttressing,  handicapped  and  non-English-speaking  students  needed  added  assistance,  all 
students  needed  to  know  more  about  other  nations,  and  so  cm  for  a  long  list  of  national 
education  needs.  The  nation  needed  to  be  rebuilt  and  improved  schools  were  a  crucial  part 
of  the  foundation. 

Educational  Laboratories  were  to  be  an  important  component  of  the  educational  chan  ge 
effort  that  was  to  be  led  by  federal  officials.  New  instructional  practices,  new  teaching 
techniques  and  materials  would  be  gathered  nationally,  or  invented  in  die  federally  funded 
Research  and  Development  Centers,  and  thai  translated  for  school  practitioners  by  the 
laboratories.  These  new  institutions  would  be  a  vital  link  in  packaging  useful  knowledge 
and  transferring  it  from  national  sources  to  local  schools.  The  national  change  agenda  for 
the  laboratories  to  follow  was  envisioned  as  being  established  by  federal  interests.  In  that 
few  if  any  similar  institutions  then  existed,  it  was  necessary  for  them  to  be  federally 
initiated  and  federally  funded 

This  notion  of  a  logical  chain  of  educational  change  was  undermined  initially  by  the 
Vietnam  War  which  fostered  cynicism  about  die  Johnson  administration  and  its  social 
programs,  stifled  national  idealism,  and  cast  a  budgetary  pall  over  domestic  spending.9 
The  Nixon  administration  did  not  share  the  vision  of  nationally  inspired  educational 
change,  and  the  Carter  administration  was  too  overwhelmed  by  world  events  and  OPEC- 
initiated  inflation  to  do  anything  more  for  education  than  make  symbolic  gestures.10  Mid 
1960s  flaming  enthusiasm  for  federally  led  education  reform  had  been  reduced  to  a  few 
smoldering  embers  of  hope  by  1980. 

Historians  can  debate  the  degree  to  which  the  1980s  were  revolutionary.  However, 
regarding  one  dimension  there  can  be  litde  disagreement  President  Reagan  did  not 
envision  the  federal  government  as  a  major  operational  force  in  education.  His  Education 
Department  officials  became  extraordinarily  adroit  in  using  the  national  visibility  of  their 

9  Gerald  Font  approved  Public  Law  94-142,  the  Edvcatkm  for  AO  Haadicapped  Chfldrea  Act. 
However,  this  mvm  not  a  highly  viable  piece  of  his  administration's  program,    was  primarily  a 
congressional  *id  interest-group  response  to  court  derisions  that  threatened  to  impose  an  unbearable  fiacal 
burden  upon  itatet  and  local  school  districts. 

10  Such  as  upgrading  the  United  States  Office  of  Education  to  cabinet  level  sums. 
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office  to  make  pronouncements  regarding  the  need  for  educational  change.  However,  the 
notion  that  the  federal  government  would  itself  develop  the  specifics  of  an  agenda,  provide 
operational  details,  and  pay  a  large  part  of  the  bill  was  oealt  a  punishing  blow. 


Regional  Laboratories,  regardless  of  their  performance  to  that  time,  were  not  viewed  by 
Reagan  officials  as  an  integral  instrument  for  promoting  federally  inspired  educational 
change.  Other  actors,  primarily  governors  and  state  legislators,  business  leaders,  chief 
state  school  officers,  and  teacher  union  officials,  were  now  rising  to  assume  leadership, 
and  Educational  Laboratories  had  their  mission  altered  to  serve  diem.  Serving  a  federal 
agenda,  one  of  the  crucial  original  purposes  for  the  Educational  Laboratories,  had 
disappeared  In  this  transition,  a  crucial  question  was  seldom  forcefully  posed 

Could  specialized  institutions,  initially  established  to  further  a  focused  federal  agenda,  be 
productively  transformed  into  a  set  of  regional  agencies  intended  to  provide  a  spectrum  of 
senses  to  a  wide  variety  of  state  and  local  client?? 

There  is  Knowledge  Worth  Brokering 

Regional  Laboratories  were  originally  conceived  as  brokers.  They  were  to  serve  as 
middlemen  in  a  chain  linking  knowledge  producers  and  knowledge  users.  Researchers 
w<  Id  invent  new  educational  techniques  and  Educational  Laboratories  would  translate  and 
sell  them  to  teachers  and  educational  administrators. 

Embedded  in  this  linking  concept  were  at  least  three  crucial  assumptions:  (1)  knowledge 
existed  or  would  be  produced  that  could  materially  enhance  instruction  in  local  schools,  (2) 
Educational  Laboratories  would  have  personnel  capable  of  identifying  the  needs  of  school 
districts  and  subsequently  locating  useful  solutions  to  their  problems,  and  (3)  Educational 
Laboratories  would  possess  or  develop  a  quality  control  capacity,  both  about  ideas  and 
personnel,  that  would  guide  self  renewal  and  enable  them  to  adapt  to  changing  conditions. 
All  of  these  assumptions  are  arguable. 

Useful  Knowledge  Existed.  Instructing  effectively  is  among  the  most  challenging  of 
human  undertakings.  To  date,  little  that  is  genuinely  scientific  is  kr  wn  about  teaching  and 
1        learning.  For  virtually  every  school  of  thought  that  develops  about  education,  a 

countervailing  view  or  advocate  emerges,  and  a  successful  synthesis  seldom  occurs. 
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Teaching  continues  to  be  far  mere  of  an  art  or  a  craft  than  a  science.  The  consequences  of 
this  condition  have  diluted  the  ability  of  Educational  Laboratories  to  fulfill  their  purposes. 

The  United  States  annually  spends  $300  billion  on  education  and  it  is  a  matter  of  great 
national  importance.  Consequently  there  are  enormous  public  and  professional  pressures 
to  identify  more  effective  educational  strategies  and  techniques.  Educators  are  generally 
accepting  of  means  and  materials  to  improve  their  performance.  However,  in  the  absence 
of  scientifically  grounded  principles  to  guide  the  search  and  adoption  of  new  procedures, 
schools  are  vulnerable  to  short-lived  fads  that  wash  over  them  with  discouraging  regularity 
and  leave  little  of  a  productive  residue  behind 

In  the  time  since  the  Educational  Laboratories9  inception,  the  education  community  has 
flirted  with  widely  touted  reforms  such  as  Program  Performance  Budgeting  Systems 
(PPBS),  Leaner  Verified  Materials,  Individually  Prescribed  Instruction  (IPI),  Computer 
Assisted  Ins*metion  (CAI),  Program  Evaluation  and  Review  Techniques  (PERT), 
Competency  Based  Teacher  Education  (CBTE),  Management  by  Objectives  (MBO).  merit 
pay,  career  ladders,  educational  "bankruptcy,"  and  "Effective  Schools."  All  of  these  have 
so  far  proved  to  be  illusory  as  widespread  strategies  for  educational  enhancement  On  the 
horizon  is  seemingly  always  another  promising  strategy  that,  finally,  will  dramatically 
revolutionize  education.  It  never  has. 

Some  day  there  may  be  a  set  of  sufficiently  proven  instructional  inventions  to  justify  their 
widespread  adoption  in  schools.  To  this  point,  however,  the  research  and  development 
effort  for  American  education  is  so  severely  limited  that  it  is  difficult  to  imagine  that  a 
scientific  breakthrough  will  occur  soon.  Regardless,  at  the  time  the  Educational 
Laboratories  were  conceived,  it  is  not  clear  that  the  then-existing  research  and  development 
base  justified  their  formation  as  knowledge  brokers.  It  is  no  more  clear  that  such  a  role  is 
justified  today. 

Assessing  Needs  and  Picking  solutions.  Determining  the  knowledge  needs  of  school 
practitioners  is  relatively  easy.  One  can  visit  schools,  talk  to  teachers,  examine  test  results, 
utilize  surveys,  and  employ  a  variety  of  other  avenues  to  compile  a  list  of  needed 
techniques  and  materials.  Identifying  effective  solutions  is  far  more  difficult  Little 
thought  appears  to  have  been  given  to  the  manner  in  which  solutions  would  be  selected  or 
to  the  training  of  individuals  who  would  be  the  brokers. 
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Assuming  that  die  nation's  research  and  development  effort  was  expansive  and  effective,  it 
would  still  be  no  easy  task  to  select  reform  ideas  that  were  best  suited  for  individual  school 
settings.  It  would  necessitate  a  cadre  of  skilled  research  brokers  in  laboratories.  Such 
knowledgeable  research-practice  brokers  did  not  exist  when  laboratories  were  founded,  and 
little  has  been  done  subsequendy  to  develqp  a  pool  of  them. 

The  most  able  individuals  in  laboratories  often  have  been  socialized  to  academic  research 
norms,  not  local  school  districts'  practices.  When  an  opportunity  presents  itself  to  return  to 
the  environment  in  which  they  were  trained,  e.g.,  accept  a  professorship,  they  frequently 
take  it  When  performed  well,  knowledge  brokering  is  an  exacting  role.  To  date,  there  is 
little  by  way  of  a  career  niche  for  laboratory  personnel,  and,  the  ability  to  identify 
prospective  solutions  to  practitioner  problems  likely  suffers  as  a  consequence. 

Quality  Control.  Professional  norms  and  peer  review  prevail  in  many  scientifically  or 
technically  based  settings.  Private-sector  brokers  are  controlled  to  a  degree  by  market 
forces.  However,  Educational  Laboratories  have  little  by  way  of  a  pea-  culture  or 
professional  norms  upon  which  to  rely.  Immediate  feedback  from  clients  is  also  difficult  to 
obtain.  In  that  laboratories  in  large  measure  are  now  funded  by  a  higher  level  of 
government  to  serve  intermediaries  who  are  assumed  eventually  to  serve  schools  districts, 
there  is  only  a  diluted  a  market  mechanism  to  provide  direct  feedback  regarding 
performance.  Initially  this  problem  was  envisioned  as  being  solved  by  the  remarkably  high 
calibre  professionals  who  were  assumed  to  be  employed  by  laboratories.  However, 
uncertain  funding  and  eroded  status  began  to  take  its  toll  on  the  ability  of  laboratories  to 
develop  and  retain  a  large  cadre  of  unusually  professional  translators  of  knowledge. 

In  the  absence  of  conventional  quality  control  mechanisms,  or  an  intensely  developed 
professional  culture,  laboratories  conduct  an  endless  round  of  self-evaluating  and  outside 
assessment  efforts.  Many  of  these  are  accurate  and  insightful.  However,  from  their 
beginning  and  continuing  to  this  day,  the  Regional  Educational  Laboratories  are  missing  a 
sustained  means  for  assessing  whether  or  not  they  are  performing  a  genuinely  useful  role. 
They  have  a  contrived  and  frequently  ineffective  feedback  loop,  and  this  is  a  difficulty 
which  has  existed  from  their  conception. 

An  Initial  Development  Phase. 
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Johnson  administration  education  officials  knew  that  the  invention  of  a  new  educational 
institution  could  not  easily  occur  overnight  and  that  experimentation  would  be  necessary.  It 
was  not  expected  that  Educational  Laboratories  would  be  an  immediate  success.  A  period 
of  trial  and  error  development  was  envisioned  However,  political  and  budgetary  pressures 
coincided  to  render  such  assumptions  impractical. 

Early  Office  of  Education  planning  emphasized  gradual  expansion  of  laboratories, 
perfecting  the  model  polishing  the  functions  they  would  perform,  and  thoughtfully 
recruiting  and  training  personnel  to  work  in  them.  The  laboratories  were  to  be  fashioned 
carefully.  However,  two  events  rendered  these  plans  inoperative.  First,  Johnson 
administration  education  officials  disagreed  among  themselves  on  the  number  and  nature  of 
the  laboratories  and  several  of  them  acquiesced  to  arguments  for  political  success  and 
agreed  that  the  laboratories  could  oe  regionally  located  to  serve  every  geographic  segment 
of  the  United  States.  Once  the  notion  had  been  aired,  there  was  little  recourse  but  to  launch 
the  new  organizations  as  Regional  Educational  Laboratories.11 


Since  there  was  now  to  be  a  laboratory  in  every  region  of  the  United  States,  there  was  little 
justification  for  opening  only  a  few  and  then  slowly  expanding  the  number.  If  a 
development  phase  was  in  order,  then  the  "development* f  would  be  necessary  everywhere. 
Otherwise,  the  lessons  learned  in  one  region  might  not  be  the  right  thing  to  learn  in  another. 
Every  geographic  sector  had  to  have  a  laboratory  and  they  had  to  have  it  from  the 
beginning.  An  unfortunate  "pork  barrel"  image  was  initiated. 


Organizational  and  Resource  Stability 


A  related  problem  was  and  has  continued  to  be  financial  and  regulatory  stability.  It  was 
initially  assumed  that  federal  funding  would  provide  the  overwhelming  proportion  of 
operating  funds  for  Educational  Laboratories.  Whatever  additional  money  they  needed 
would  result  from  the  sale  of  products  and  services,  related  to  knowledge  brokering.  (It 
was  school  districts  that  were  envisioned  as  the  primary  markets  for  the  sale  of  these 
"products.")  There  were  few  discussions  initially  regarding  repeated  or  cyclical 
competitive  bidding  for  laboratories.  In  effect,  these  new  institutions  were  to  be  arms  of 


11  The  Atomic  Energy  Commission  national  laboratories,  major  models  for  the  Educational  Laboratories, 
were  located  in  various  regions  of  the  United  States.  However,  it  was  widely  understood  that  each  AEC 
laboratory,  whatever  its  geographic  location,  served  national  purposes.  This  distinction  appears  not  to  have 
been  put  forth  with  sufficient  force  in  the  instance  of  the  Education  Laboratories. 
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the  federal  government's  education  interests,  and,  thus,  would  be  sustained  the  same  way 
the  Agricultural  Extension  agents  or  Atomic  Energy  Commission  National  Laboratories 
were  funded.12 

Also,  laboratories  were  to  be  protected  from  rapidly  revolving  regulatory  changes  so  that 
over  time  they  could  develop  vision,  purpose,  and  productivity.  This  kind  of  stability 
would  enable  laboratories  to  carve  out  for  themselves  a  productive  niche  among  the 
network  of  America's  educational  institutions. 

These  assumptions  were  invalid  virtually  from  the  point  of  Laboratory  formation.  Money 
was  a  root  problem.  By  the  time  the  Great  Society  was  scheduled  to  shift  into  high  gear, 
the  Vietnam  War  was  becoming  exceedingly  expensive.  Domestic  spending  levels  initially 
envisioned  for  the  "War  on  Poverty"  were  never  realized.  Even  in  the  Nixon 
administration,  the  projected  "Fiscal  Dividend'9  for  domestic  programs  which  was  to  result 
from  a  Vietnam  withdrawal  did  not  occur.  Nixon's  budgetary  officials  were  unusually 
creative  in  pursuing  money-saving  techniques  such  as  budgetary  "Impounding,"  whereby 
the  president  simply  refused  to  approve  expenditures  even  though  Congress  appropriated 
the  funds.13  Congress  eventually  devised  means  for  overriding  residential  spending 
reluctance,  but  by  then  it  was  too  late.  Inflation  and  mounting  federal  deficits  began  to 
place  both  the  executive  and  the  legislative  branch  in  a  more  frugal  frame  of  mind  when  it 
came  to  social  programs. 

Education  under  Carter  had  to  struggle  mightily  to  stay  abreast  of  double-digit  inflation. 
Little  else  emerged  during  the  1970s.  Reagan  administration  budget  proposals  did  not  even 
seek  such  annual  increases.  Thus,  during  their  quarter  century  history,  Regional 
Educational  Laboratories  have  never  benefitted  from  stable  funding,  let  alone  the  substantial 
resource  levels  initially  envisioned  to  support  their  early  development  The  period  of 
planning,  pilot  testing,  experimentation,  and  polishing  was  never  to  be.  Regional 


12  Competition  is  held  periodically  10  determine  the  management  of  the  national  laboratories  now  funded 
by  tin  Department  of  Energy  or  the  Defense  Department.  However,  these  rebidding  efforts  seldom  involve 
a  wrenching  attention  of  mission  or  revision  of  purpose. 

*3  It  was  during  this  period  that  education  interests  groups  swallowed  organizational  diffecuces  of  opinion 
and  formed  die  Energeacy  Coutttee  for  Fill  Funding.  Their  strategy  was  to  lobby  Congress  to 
override  executive  branch  spending  curtailment  It  became  evident  that  education  funding  would  always  be  a 
problem,  not  simply  a  short-term  emergency,  and  former  Washington  Senator  Warren  Magnuaon  convinced 
educators  that  "fall"  funding  was  a  practical  impossibility.  Thus,  today  the  organization  is  known  as  the 
Committee  for  Education  Funding. 
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Educational  Laboratories,  once  established,  were  thrown  into  the  arena  of  competitive 
budgetary  politics  and  immediately  expected  to  produce  tangible  results. 


By  the  late  1970s  laboratories  and  R&D  Centers  occupied  such  a  large  proportion  of  the 
NEE  budget  that  federal  education  officials  saw  themselves  as  having  virtually  no  resource 
discretion  to  meet  emerging  national  research  needs.  They  could  not  respond*  except  by 
attempting  to  focus  R&D  Center  and  laboratory  attention  on  a  problem.  This  contributed 
to  an  evolving  regulatory  environment  which  placed  ever  tighter  constraints  around 
laboratory  purposes. 

Because  of  the  inability  to  predict  resource  levels,  Regional  Educational  Laboratories 
seldom  have  sufficient  stability  to  pursue  a  sustained  course  of  action.  Many  laboratories, 
and  particularly  some  of  those  that  are  judged  as  successful,  have  had  to  become 
entrepreneurial.  They  bid  competitively  on  service,  evaluation,  and  consulting  contracts  in 
their  regions  and  elsewhere.  They  seek  grant  funding  from  foundations.  With  the 
necessity  for  finding  outside  funding,  money  to  augment  federal  appropriations,  they  have 
to  fragment  their  professional  educational  efforts  to  accomplish  activities  which  may  not  be 
squarely  aligned  with  a  knowledge-brokering  agenda. 

Being  entrepreneurial  is  not  all  bad.  Financial  instability  can  sensitize  laboratories  to 
markets  in  a  manner  that  full  federal  funding  might  not  do.  What,  then  is  the  problem? 
Enterprise  has  its  virtues,  but  the  market  place  may  not  adequately  reflect  the  greatest  need 
for  laboratory  services.  Educational  organizations  with  the  financial  resources  to  seek 
outside  consulting  and  evaluation  services  may  not  be  the  agencies  most  in  need  of 
Regional  Educational  Laboratory  assistance.  For  example,  it  is  seldom  school  districts, 
particularly  small  ones,  that  have  the  resources  to  pay  for  outside  help. 

Federal  funding  uncertainty  and  changing  views  of  the  federal  role  also  contributed  to 
alterations  in  the  rtr  'atory  environment  of  Regional  Educational  Laboratories.  Through 
monitoring  procedures  and  periodic  rebidding,  laboratory  purposes  began  to  slide  from  the 
original  Johnson  administration  academic/technical  knowledge  brokering  model  to  a  more 
opportunistic  consultative  model.  The  latter  was  made  particularly  explicit  with  the  most 
recent  insertion  of  the  Reagan  administration  "With  and  Through"  strategy  whereby 
laboratories  were  also  expected  to  assist  school  districts  by  cooperating  with  and  operating 
through  other  agencies.  The  initial  assumption  of  laboratories  as  a  direct  link  between 
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knowledge  producers  and  knowledge  users,  classrooms,  schools,  and  school  districts,  had 
now  been  substantially  altered 

Resource  instability  also  stimulated  Educational  Laboratories  to  engage  in  bold  political 
activities  to  sustain  federal  funding.  By  forming  an  organization,  the  Regional  Laboratories 
and  R&D  centers  could  act  in  concert  to  represent  their  views  before  Congress.  The 
employment  of  an  unusually  able  executive  director  permitted  this  umbrella  organization  to 
make  its  case  to  Congress,  frequently  with  more  force  than  the  executive  branch 
Department  of  Education  officials  who  supposedly  were  overseeing  R&D  Centers  and 
Regional  Educational  Laboratories.  These  overt  political  efforts  were  successful  in 
providing  what  little  budgetary  stability  laboratories  enjoyed  However,  politicization  did 
little  to  reassure  die  broader  research  community  that  die  laboratories  were  worthwhile 
based  on  the  quality  of  their  professional  research,  development,  and  dissemination  results. 
Indeed,  politicization  and  competition  for  scarce  federal  funds  drove  an  unproductive 
wedge  between  the  larger  educational  research  community  and  the  Regional  Laboratories, 
the  very  groups  that  were  supposed  to  be  joined  together  by  the  original  enabling 
legislation. 

Task  Specialization. 

Initially  it  was  assumed  that  Regional  Laboratories  would  specialize.  Prior  to  the 
invention,  or  political  imposition,  of  regionalization,  each  developed  laboratory  would 
carefully  select  a  curriculum  area  or  instructional  strategy  in  which  to  become  expert 
Recruitment  of  personnel  and  the  honing  of  procedures  would  render  a  particular  laboratory 
the  place  for  school  districts  to  come  when  plagued  by  the  special  problem  on  which  the 
laboratory  concentrated.  Over  time,  laboratories  would  be  able  to  build  a  reputation  as 
brokering  knowledge  in  specific  practical  fields,  e.g.,  reading,  writing,  mathematics, 
special  education,  gifted  and  talented  youngsters,  bilingual  education,  and  vocational 
education. 

Task  specialization  was  made  difficult  by  two  developments — regionalization  and  the  need 
to  engage  in  entrepreneurial  activity.  If  a  laboratory  was  to  serve  a  region,  then  it  had  to 
develop  a  full  portfolio  of  those  dimensions  of  interests  to  "clients"  in  its  geographic  area. 
Laboratory  employees  would  now  have  to  cover  several  bases,  not  simply  become  expert 
in  one. 
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Additionally,  enterprise  demanded  that  laboratories  respond  to  die  markets  available  to 
them,  regardless  of  their  specific  initial  agenda.  Enterprise  by  itself  might  still  permit 
specialization.  However,  the  mixture  of  enterprise  and  rcgionalization  meant  that 
laboratories  bad  to  develop  a  portfolio  consistent  with  die  market  place  and  foundation 
interests  in  their  region.  They  could  not  easily  risk  specialization  and  playing  in  a  national 
market  on  only  one  dimension.  Task  specialization  was  no  longer  a  valid  assumption 
virtually  from  the  day  regional  laboratory  funding  competitions  were  announced 

Being  Part  of  a  Synergistic  System 

Regional  Educational  Laboratories  were  originally  conceived  of  as  only  one  of  several 
specialized  constellations  in  a  galaxy  of  research  and  development  strategies.  In  addition  to 
research  efforts  in  universities  and  federally  funded  Research  and  Development  Centers, 
Educational  Laboratories  would  be  complemented  by  a  substantial  program  of  field-initiated 
studies  wherein  individual  researchers  and  research  teams  would  also  be  federally  funded 
to  conduct  inquiry  about  a  wide  range  of  fundamental  and  applied  education  problems. 

Over  time,  primarily  because  of  the  above-described  funding  difficulties,  Individual 
components  of  this  research  and  development  spectrum  became  badly  eroded.  Funding  for 
universities  has  been  diminished  substantially,  R&D  centers  have  been  reduced  in  number 
and  funding,  and  field-initiated  studies  remain  only  in  a  symbolic  sense.  To  be  sure,  new 
agencies  have  evolved  since  the  inception  of  Educational  Laboratories,  e.g.,  many  more 
private  and  not-for-profit  consulting  firms,  university-based  policy  analysis  units,  and  the 
Education  Commission  of  the  States.  However,  these  were  not  originally  envisioned  and 
they  certainly  are  not  now  woven  into  a  federally  coordinated  infrastructure  in  the  manner 
that  Educational  Laboratories  and  the  other  R&D  components  v,ere  originally  supposed  to 
be. 

In  effect,  the  entire  education  Research  and  Development  strategy  conceived  by  Johnson 
administration  planners  has  dissembled.  No  new  overarching  strategy  has  been  designed 
to  replace  it.  Only  fragmented  components  of  the  original  plan  remain,  and  they  are  unable 
to  meet  the  challenge.  Regional  Educational  Laboratories  continue,  and  so  do  R&D 
centers.  However,  these  institutions  now  are  expected  to  carry  virtually  the  nation's  entire 
education  research  and  development  burden  and  they  are  ill  suited  to  the  task,  both  in 
concept  and  resources. 
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Direct  Links  to  School  Districts 


The  original  conception  of  Educational  Laboratories  envisioned  their  serving  as  direct  links 
between  knowledge-producing  agencies  and  school  districts.  This  never  occurred  in  the 
manner  initially  planned  because  of  many  intervening  conditions,  not  the  least  erf  which 
was  uncertain  funding.  However,  the  Reagan  administration's  adoption  of  the  so-called 
"With  and  Through*9  strategy  made  it  clear  that  direct  linkage  between  laboratories  and  local 
school  districts  was  eroded.  "With  and  Through"  may  have  been  a  realistic  recognition  of 
what  was  possible.  After  all,  there  were  only  a  limited  number  of  laboratories  and  fifteen 
thousand  school  districts.  Multiplying  laboratory  efforts  by  cooperating  with  other  change 
agent  institutions  was  certainly  logical  However,  this  alteration  had  another  consequence. 
It  also  diluted  a  major  feedback  loop  regarding  laboratory  performance. 

Now  that  laboratories  were  to  operate  "with  and  through"  other  agencies,  their 
effectiveness  could  not  be  as  easily  and  directly  appraised.  An  indirect  operating  strategy 
substantially  reduced  the  prospect  of  a  local  school  district  administrator  or  teacher 
accurately  being  able  to  identify  a  Regionajiducational  Laboratory  as  a  source  of  useful 
ideas,  techniques,  or  materials.  Regional  Educational  Laboratories  were  like  stealth 
bombers.  State  education  departments,  county  offices  of  education,  state  school  board  or 
administrator  associations,  or  teacher  unions  might  be  the  agencies  in  most  direct  contact 
with  local  school  districts,  and  Educational  Laboratories  would  be  sufficiently  far  in  the 
background  as  to  be  invisible  on  school  district  "radar  screens."  Evaluation  became  the 
more  difficult  as  a  consequence. 

Part  Three 
Alternative  Strategies  for  the  Future 

Proposing  an  entire  new  education  Research  and  Development  strategy,  however  badly 
needed,  is  beyond  the  scope  of  this  essay.  The  following  planning  and  operational 
alternatives  are  restricted  to  Regional  Educational  Laboratories.  These  proposals  are 
intended  to  overcome  three  fundamental  laboratory  problems:  (1)  an  ambiguous 1 'mission" 
resulting  from  almost  a  quarter  century  of  policy  neglect  and  regulatory  accretion, 
(2)  insufficient  resources  to  accomplish  whatever  purposes  emerge,  and  (3)  the  absence  of 
a  forceful  evaluation  mechanism  or  performance  feedback  loop. 
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The  proposed  strategies  involve  altering  one  or  a  combination  of  policy-related  dimensions, 
e.g.,  federal  funding  levels,  specified  clientele,  subject-matter  specialities,  and  performance 
incentives.  Like  the  plans  laid  almost  twenty-five  years  ago,  these  proposed  strategies  axe 
also  predicated  upon  crucial  assumptions.  These  are  made  explicit  below  in  order  to  enable 
readers  better  to  assess  the  utility  of  individual  alternatives. 

Assumptions 

Not  only  are  Regie  nal  Educational  Laboratories  likely  to  continue,  they  also  are  likely  to 
continue  in  their  current  configuration.  That  is,  the  laboratories  will  be  ''regional." 
However  many  of  them  there  is  to  be,  their  responsibilities  will  provide  complete  territorial 
coverage  for  the  United  States.  Looked  at  another  way,  each  laboratory  will  continue  to 
have  a  geographically  designated  constituency. 

Federal  funding,  at  least  in  the  next  four  to  eight  years,  will  be  insufficient  to  permit 
laboratory  expansion,  and  may  prove  insufficient  even  to  sustain  current  levels  of  effort 
In  most  geographic  regions,  additional  financial  resources  will  be  necessary. 

Economic  and  political  conditions  are  unlikely  ever  to  extend  to  Regional  Educational 
Laboratories  the  long-term  funding  stability  of  research  universities  or  many  other  public 
educational  institutions.  Therefore,  some  of  the  organizational  consequences  of 
uncertainty,  such  as  turnover  among  high-level  laboratory  personnel  and  periodic 
redirection  of  purpose,  should  systematically  be  anticipated. 

State  governments  will  continue  for  the  foreseeable  future  to  be  the  primary  agenda-setting 
agencies  for  American  education. 

Alternative  Strategies  for  the  Future 

Given  that  many  erf  the  original  hopes  for  Regional  Educational  Laboratories  nave  proven 
impossible  to  realize,  and  the  educational  policy  landscape  has  been  altered  substantially 
since  their  inception,  what  realistically  can  be  undertaken  presently  to  render  these 
institutions  more  effective?  Seven  alternatives  are  proposed  below: 

Status  Quo.  Of  course,  muddling  through  with  the  current  set  of  arrangements  is 
always  one  possibility.  In  the  event  agreement  cannot  be  reached  for  changing 
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laboratories,  not  all  is  lost  Several  of  the  existing  institutions  are  judged  to  be  effective  for 
their  region,  and  over  time,  thoughtful  monitoring  and  careful  managerial  attention  might 
strengthen  the  weaker  laboratories.  However  time  consuming  this  strategy  might  be,  it 
would  have  die  virtue  of  attempting  to  salvage  the  large  investments  already  made.  If  this 
strategy  is  distasteful  to  laboratory  proponents,  it  should  be  assessed  relative  to  the 
alternative  of  eliminating  Regional  Educational  Laboratories  altogether. 

Elimination.  Would  it  be  better  to  eliminate  Regional  Laboratories  altogether?  They 
have  been  unable  generally  to  meet  the  expectations  initially  held  for  diem.  Evaluations 
reveal  an  uneven  set  of  current  performances.  They  absorb  a  remarkable  proportion  of  the 
slender  amount  of  education  research  and  development  funding  available  in  the  United 
States.  Perhaps  die  appropriate  answer  is  simply  to  perform  institutional  triage  and  redirect 
their  financial  support  to  other  endeavors  and  agencies,  such  as  the  Research  and 
Development  Centers  or  field  initiated  research. 

Of  course,  not  all  laboratories  would  have  to  be  eliminated  under  this  strategy.  Selection 
could  be  made  of  the  three  or  four  least  effective  laboratories;  they  could  be  closed  or 
phased  out  and  their  resources  reallocated  to  the  others.  Geographic  boundaries  would 
have  to  be  redrawn  to  maintain  complete  national  coverage.  One's  position  on  this 
proposal  might  be  influenced  by  knowing  the  probability  that  Regional  Laboratory  funding 
could  in  fact  be  redirected  or,  would  simply  be  utilized  'o  satisfy  demand  .v  reducing  the 
overall  federal  budget  deficit 

Entrepreneurial  Intensity.  Several  Regional  Educational  Laboratories  already  engage  in 
substantial  entrepreneurial  effort  in  order  to  enhance  their  budgets.  This  is  *  nixed 
blessing.  It  has  the  potential  disadvantage  of  seducing  laboratories  into  less-than-crucial 
activities,  or  at  least  activities  that  are  less  than  crucial  for  promoting  greater  effectiveness  in 
school  districts.  This  is  particularly  the  case  because  local  school  districts  seldom  have  the 
financial  resources  to  contract  for  services  of  the  nature  that  laboratories  can  offer.  On  the 
other  hand,  when  laboratories  subject  themselves  to  market  competition  they  gain  a 
measure  of  the  degree  to  which  their  services  are  desired  by  potential  consumers. 
Entrepreneurial  activity  does  provide  a  feedback  loop  that  frequently  is  otherwise  missing. 
Also,  entrepreneurs  are  forced  to  become  sensitive  to  the  needs  and  views  of  clients. 
Inappropriate  bureaucratic  procedures  and  organizational  indifference  are  frequently 
reduced. 
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One  strategic  alternative  is  to  sustain  "With  and  Through"  tactics  and  utilize  entrepreneurial 
incentives  to  enhance  the  prospect  that  laboratories  are  performing  useful  functions  for 
regional  clients.  All  laboratories  would  be  encouraged  to  supplement  their  funds  by 
competitively  bidding  for  grants  and  contracts  within  their  geographic  service  areas. 
Annual  fedrral  funding  levels  could  be  reduced,  over  time,  and  more  laboratories  could  be 
formed  with  the  savings. 

Explicitly  acknowledging,  indeed,  deliberately  intensifying,  entrepreneurial  activity  by 
laboratories  would  have  several  advantages.  It  could  spread  federal  resources  more  widely 
than  now  is  the  case,  even  offering  Ac  prospect  of  initiating  additional  laboratories.  It 
would  provide  a  more  forceful  evaluative  dimension  than  presently  is  possible.  It  would 
enhance  the  probability  that  laboratories  were  indeed  sensitive  to  the  needs  and  outlooks  of 
the  clients  they  attempt  to  serve.  Last,  it  would  substantially  supplement  the  range  of 
consulting  services  available  in  some  regions  of  the  United  States  where  large  national 
private  and  not-for-profit  agencies  currently  maintain  only  a  minimal  presence. 

An  intensified  entrepreneurial  strategy  would  have  obvious  disadvantages.  It  might  do  little 
to  bring  laboratory  services  directly  to  local  school  districts.  "With  and  through" 
disadvantages  would  unlikely  be  corrected.  Additionally,  laboratories  would,  in  effect, 
become  "Job  Shops."  In  time  there  might  be  little  to  distinguish  them  from  profit  and  not- 
for-profit  consulting  firms,  with  all  the  advantages  and  disadvantages  that  such  agencies 
exhibit.  In  major  metropolitan  areas  of  the  United  States,  there  is  already  a  sufficient 
number  of  such  agencies,  though  there  probably  is  no  harm  in  adding  a  few  more  to  the 
marketplace.  However,  in  less  well-developed  regions,  having  a  full-service  consulting 
agency  would  probably  be  an  advantage  over  what  currently  is  available. 

Entrepreneurial  activity  could  be  mandated  through  regulation.  Additionally,  it  could  be 
encouraged  by  using  federal  funding  on  a  matching  basis.  For  example,  for  every  $4  that  a 
laboratory  raised  entrepreneurially,  it  would  receive  $1  in  federal  matching  funds,  up  to  a 
specified  ceiling  amount 

Service  Credit  Accounts."  This  strategy  oTers  a  means  for  intensifying  "With  and 
Through"  tectics,  enhancing  laboratory  sensitivity  to  client  needs,  ensuring  relevance  to 
contemporary  educational  developments,  and,  when  linked  to  a  resource  matching  strategy, 
expanding  funding  available  to  laboratories.  The  following  scenario  offers  one  illustration 
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of  the  manner  in  which  a  "Service  Credit  Account"  strategy  mignt  operate.  Other  scenarios 
are  also  possible. 

This  procedure  would  encumber  Laboratory  resources  for  use  by  designated  clients. 
Within  each  geographic  region,  laboratories  would  have  "Designated  Clients/'  These  might 
include,  or  be  limited  exclusively  to,  one  or  a  combination  of  individuals  and  organizations 
such  as  chief  state  school  officers,  governors,  legislative  leaders,  state  school  board 
associations,  or  major  professional  educator  interest  groups.  A  laboratory's  designated 
client  or  clients  would  be  allocated  a  "Service  Line  of  Credit"  which  could  be  drawn  upon 
for  consulting,  policy  analyses,  research,  or  staff  development  during  the  course  of  the 
budget  year. 

These  service  allocation  arrangements  could  be  intensified,  and  constructed  to  provide  a 
performance  feedback  loop,  by  requiring  that  designated  clients  match  federal  funds  in  their 
individual  Service  Credit  Accounts.  Matching  need  not  be  on  a  dollar-for-dollar  basis. 
Almost  any  reasonable  matching  ratio  suffices  to  gauge  the  extent  to  which  designated 
clients  believe  the  service  is  of  value  to  them. 

Designated  clients  would  specify  the  general  nature  of  services  they  would  expect  during 
the  forthcoming  contractual  period.  These  discussions  would  facilitate  laboratory  planning 
and  personnel  recruitment  Prior  agreement  would  also  be  reached  regarding  the  "rate"  at 
which  laboratory  services  wop'd  be  billed  against  a  client's  line  of  credit 

"Service  Credit  Accounts"  and  the  accompanying  concept  of  'Designated  Clients"  would 
also  have  advantages  and  disadvantages.  Laboratory  sensitivity  to  clients9  needs  would  be 
intense.  Performance  feedback  would  be  facilitated,  particularly  if  financial  matching 
requirements  were  instigated  Laboratory  stability  might  be  further  enhanced  by  the  added 
degree  of  political  support  that  could  result  from  such  arrangements.  Excessive  indirect 
overhead  costs  could  be  minimized  by  specifying  the  proportion  of  federally  funded 
resources  that  had  to  result  as  direct  services  to  designated  clients.  Advanced  planning  with 
clients  would  enable  laboratories  to  know  with  greater  assuredness  what  their  personnel 
needs  would  be,  at  least  for  a  year,  and,  depending  upon  the  planning  horizons  involved, 
perhaps  as  long  as  a  multiyear  federal  contract  cycle. 

I 

An  additional  advantage  of  the  "Service  Line  of  Credit"  is  die  renewed  possibility  of 
attracting  added  actors  into  laboratory  rebidding  competitions.  Restricting  the  prospective 
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clientele  of  laboratories,  would  probably  reduce  the  range  of  their  substantive 
responsibilities.  Under  a  "Line  of  Credit"  arrangement  and  fewer  clients,  laboratories 
would  not  have  to  spread  themselves  as  thinly  as  has  been  the  case  in  several  past 
instances.  Greater  specialization  might  facilitate  higher  quality  performance.  Also,  a 
narrower  band  of  expectations  might  reasonably  encourage  a  wider  range  of  other  agencies 
to  compete  for  laboratory  funding  when  rebidding  was  scheduled. 

The  disadvantages  are  those  accompanying  an  even  a  more  intense  version  of  the  "With  and 
Through"  strategy.  For  example,  designated  clients  might  monopolize  such  a  large 
proportion  of  laboratory  resources,  unless  otherwise  protected  by  federal  regulatory 
agreement,  that  small  clients  would  be  neglected.  Also,  the  "Service  Credit"  strategy  runs 
the  risk  of  unproductively  entangling  laboratories  in  state  and  regional  politics.  Lastly, 
clients  now  benefitting  from  laboratory  services  might  view  the  "Service  line  of  Credit"  as 
a  contrived  encumbrance  which  simply  makes  their  lives  more  complicated  without 
providing  additional  advantages. 

Specialized  Think  Tanks.  Yet  another  strategy  is  deliberately  to  encourage  Regional 
Educational  Laboratories  to  become  specialized  'Think  Tanks."  The  above-described 
"Service  Credit  Account"  would  likely  reduce  the  spectrum  of  clients  for  laboratories.  A 
"Specialized  Think  Tank"  strategy  would  likely  reduce  the  substantive  spectrum  for  which 
any  particular  Laboratory  is  responsible.  A  laboratory  would  specialize  in  one  or  a 
restricted  range  of  topics  consistent  with  federal  directives,  regional  needs,  or  a 
combination  of  the  two. 

For  example,  state  officials  appear  to  desire  greater  policy  analytic  services.  Regional 
Education  Laboratories  could  specialize  in  die  provision  cf  this  service  to  states  in  their 
geographic  area.  Similarly,  a  laboratory  might  specialize  in  future  planning  for  a  region, 
cyclically  undertaking  a  variety  of  demographic,  economic,  personnel  and  financial 
projections.  Yet  another  example  is  a  laboratory  that  specialized  in  program  evaluation  and 
became  known  for  providing  high  calibre  assessment  services  to  regional  clients.  Lastly,  a 
laboratory  might  specialize  in  activities  such  as  strategic  planning,  business  systems, 
testing,  or  instructional  improvement  for  states  ard  large-scale  education  organizations 
within  its  service  area. 

Enough  has  been  said  to  this  point  regarding  advantages  and  disadvantages  of  previously 
described  strategies  that  additional  detail  is  perhaps  superfluous.  Suffice  it  to  say  that 
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restricting  laboratory  substance  offers  an  opportunity  to  gain  high  performance  through 
specialization.  Accountability  might  also  be  enhanced  because  the  range  of  expectations  for 
a  particular  laboratory  would  be  reduced  Substantive  specialization  could  also  be 
accompanied  by  federal  matching  requirements  so  as  to  encourage  entrepreneurial  activity, 
expanded  fund  raising,  and  client  accountability.  The  disadvantages  would  include 
diminished  contact  with  operating  school  districts  and  a  narrower  spectrum  of  knowledge 
translation. 

Combination  Strategies.  The  above-listed  strategic  alternatives  are  not  necessarily 
mutually  exclusive.  It  is  possible  to  combine  many  of  diem.  For  example,  entrepreneurial 
activity  and  matching  requirements  can  be  utilized  in  most  every  instance.  Similarly, 
restricting  fiinctions  and  designating  a  smaller  spectrum  of  clients  can  also  be  accomplished 
simultaneously. 

Part  Four 
Conclusion 

What  is  the  'tight  thing"  to  do  about  Regional  Educational  Laboratories?  The  answer  to 
this  question  will  depend  heavily  upon  the  perspective  of  the  respondent  However,  it  is 
difficult  to  respond  objectively  in  the  absence  of  an  overarching  federal  government 
education  research  and  development  strategy.  Such  a  strategy  was  constructed  a  quarter 
century  ago.  It  has  not  been  systematically  revisited  since.  The  conditions  of  American 
education  have  been  altered  sufficiently  that  a  previously  developed  strategy,  even  if  there 
were  a  current-day  desire  to  pursue  it,  is  no  longer  appropriate.  What  is  needed  is  a  high- 
level  feview,  undertaken  cooperatively  by  the  education  community  and  appropriate 
government  officials.  In  the  absence  of  such  a  set  of  full  deliberations,  this  essay  offers 
alternative  strategies,  probably  interim  ones,  for  productive  future  deployment  of  Regional 
Educational  Laboratory  resources. 
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The  Future  Direction  of  Regional  Education  Laboratories 
in  Contributing  to  Urban  School  Improvement 

The  assessment  of  any  institution  serving  urban  schools  must  reflect  the  condition 
and  changing  needs  of  urban  education.  This  paper  examines  the  current  and  future 
roles  of  supporting  organizations  such  as  education  laboratories  given  the  progress  and  " 
problems  of  the  school  systems  they  are  designed  to  serve.  In  doing  so,  the  paper  is 
intended  to  offer  observations  and  suggestions  to  improve  the  service  of  these  support 
organizations  in  the  future. 

Regional  education  laboratories  have  been  a  pan  of  the  education  landscape  for  a 
considerable  period  of  time.  In  this  time  they  have  made  significant  contributions  to 
the  improvement  of  education.  Their  major  contribution  has  been  the  introduction  of 
research  and  development  practices  and  information  which  have  enhanced  state  and  local 
problem-solving  capacities.  Labs  have  been  able  to  publish  research  and  development 
reports  on  all  aspects  of  educational  improvement  and  have  disseminated  these 
documents  quite  widely  both  within  their  regions  and  nationally.  Labs  also  have 
conducted  significant  research  that  has  contributed  to  the  overall  knowledge  base  about 
teaching  and  leaniing. 

A  principal  strength  of  education  laboratories  is  in  the  education  research  and 
development  network  of  which  they  are  a  part.  The  extent  to  which  labs  utilize  this 
network  to  strengthen  their  capacity  to  serve  schools  must  be  primary  to  their 
assessment.  The  basic  design  of  the  education  labs  and  centers  was  based  on  the  belief 
that  state-of-the-art  research  knowledge  was  essential  to  improvement  of  education 
practice.  The  division  of  labor  between  labs  and  centers  was  that  university-based 
"inters  would  specialize  in  "knowledge  production"  and  the  labs  would  focus  on 
"knowledge  application."  What  has  transpired  over  the  years,  however,  is  that  labs  have 
become  more  autonomous  and  interaction  between  education  labs  and  centers  has  not 
increased  as  was  once  hoped. 

Several  factors  have  contributed  to  this  lack  of  interaction.  OERI,  itself  has 
contributed  by  setting-up  an  environment  of  competition  between  the  labs  and  centers 
that  has  worked  against  fostering  interaction.  At  times  the  agency  has  shown  a 
definite  preference  for  the  work  of  research  centers  over  that  of  labs.    Attempts,  for 
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example  have  been  made  to  modify  the  allocation  of  resources  between  labs  and  centers 
that  would  have  significantly  impacted  lab  funding.  The  labs  responded  to  the  threat  of 
reduced  funding  through  political  action.  The  result  while  successful  for  labs  resulted 
in  an  environment  of  mistrust  not  only  for  the  agency  but  also  for  the  centers 
themselves  that  were  now  seen  as  competitors  rather  then  colleagues.  The  current 
make-up  or  the  lab  and  center  advocate  organization,  CEDaR  is  a  testament  to  this 
fracture  in  relationship.  Most  of  the  centers  are  no  longer  active  members  in  this 
organization. 

The  absence  of  effective  interaction  within  the  lab  and  center  network  has 
resulted  in  considerable  unevenness  in  the  services  labs  provide  as  well  as  in  the  labs' 
overall  capacity  to  represent  the  best  and  most  current  research  knowledge  available  for 
problem  resolution.  This  isn't  to  say  that  labs,  as  we  have  seen,  have  not  made 
contributions  both  in  the  development  of  knowledge  and  the  application  of  that 
knowledge  to  solving  problems.  The  concern  raised  here  is  that  labs  have  been  less 
efficient  and  have  been  diminished  in  their  capacity  to  contribute  to  local  problem- 
solving  because  of  their  increased  isolation  from  research  centers  and  the  research 
community  in  general;  except  in  areas  that  are  compatible  with  their  own  research 
interests.  For  years  labs  hired  their  own  researchers  almost  in  competition  with 
research  centers.  The  argument  put  forward  was  that  labs  required  their  own  research 
capacity  to  be  responsive  to  the  needs  of  their  regions.  Current  concerns  for  greater 
effectiveness  in  the  support  services  from  education  laboratories  to  urban  school 
districts  is  now  more  important  then  ever  stems,  from  the  growing  need,  particularly  of 
urban  school  systems,  to  effectively  deal  with  some  of  the  complex,  lingering  issues 
which  to  date,  have  only  been  marginally  addressed. 

As  will  be  seen  from  the  following,  the  needs  or  urban  schools  are  so  pervasive 
and  pressing  that  a  coordinated  approach  to  solving  these  problems,  at  a  level  that 
makes  a  difference,  and  that  is  the  classroom,  must  become  an  operational  reality. 

Present  and  Future  Needs  of  Urban  Schools 
Urban  Schools  as  Schools  for  the  Poor 

Our  urban  schools  are  increasingly  becoming  schools  for  the  poor.  In  addition  to 
doing  a  better  job  of  educating  students  from  poor  families,  we  also  need  to  reestablish 
public  education  as  the  universal  educational  institution  for  all  of  our  young  people.  At 
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the  saiLj  time  we  have  been  integrating  schools  racially,  they  have  become  more 
segregated  economically.  This  segregation  erodes  the  local  economic  base  for  urban 
schools  as  well  as  the  role  of  public  schools  as  the  primary  educational  institution  for 
all  students,  with  or  without  financial  means.  All  institutions  concerned  with 
improvement  of  urban  education  must  work  toward  increasing  community  support  for 
these  public  schools  and  help  find  ways  to  attract  and  retain  the  participation  of  middle 
and  upper  class  families. 

Student  Achievement  Beyond  the  Basics 

Student  achievement  remains  the  primary  concern  of  urban  schools.  Though  we 
have  made  some  progress  in  improving  basic  skills,  the  ability  of  students  to  organize 
this  information  and  use  it  effectively  to  solve  problems  is  severely  limited.  Though 
this  is  a  general  problem  in  all  school  systems  aud  at  all  levels  of  education,  it  is  most 
severe  in  urban  schools.  This  is  the  primary  reason  for  the  dramatic  decline  in 
standardized  test  scores  at  the  secondary  level  and  why  urban  school  students  do  so 
poorly  on  SAT's.  The  problems  students  are  having  in  academic  performance  are 
direcdy  attributable  to  the  quality  of  instruction  they  are  receiving.  Specifically,  urban 
schools  need  curricular  and  instructional  approaches  that  will  enable  students  to  develop 
higher  order  problem-solving  and  critical  thinking  skills. 

This  particular  need  provides  a  good  example  of  how  a  critical  concern  of  urban 
schools  has  not  been  adequately  addressed,  partially  due  to  the  lack  of  an  effective 
research  into  practice  network.  School  systems  need  help  from  cognitive  research  in 
understanding:  th*  learning  problems  their  students  are  having;  what  instructional 
strategies  work;  and  how  these  strategies  can  be  tailored  to  particular  learning  styles. 
We  not  only  need  to  know  what  strategies  work,  but  also  need  help  in  figuring  out  how 
to  effectively  transfer  this  knowledge  through  staff  development  to  curriculum 
developers,  instructional  supervisors  and  teachers.  Though  these  concerns  may  appear 
obvious,  the  answers  remain  perplexing  and,  as  yet,  urban  schools  have  received  only 
limited  help  from  external  support  agencies  in  resolving  them. 

Related  to  the  above  is  the  need  for  urban  schools  to  expand  the  capacity  of 
urban  educators  to  use  technology  as  an  aid  in  teaching  higher  order  problem-solving 
skills  as  well  as  enabling  students  themselves  to  use  technology  directly  in  their 
information  organizing  and  problem-solving  pursuits.    The  research  and  development  to 


develop  more  effective  and  integrated  computer  assisted  instruction  would  be  particularly 
valuable  to  urban  settings.  Here  is  a  perfect  example  of  missed  opportunity.  Both  the 
Harvard  Center  on  Technology  and  the  Northwest  Lab  have  done  extensive  work,  one  on 
education  technology  development  and  the  other  on  technology  eviluation  and 
application.  We  all  should  be  benefiting  extensively  from  this  work.  Urban  schools 
instead  are  still  fumbling  along,  generally  behind  the  sme  of  the  art  in  both  research 
and  practice  in  the  use  of  technology  to  improve  instruction. 

Students  At  Risk 

Although  "students  at  risk'*  is  a  currently  popular  and  overworked  phrase,  we  still 
know  very  little  about  these  students  and  how  to  be  most  helpful  to  them.  We  need 
from  the  research  and  development  community  better  and  earlier  identification 
procedures  for  students  who  are  at  risk  of  school  failure  and  dropping  out.  We  also 
neeu  better  monitoring  systems  for  these  students  to  determine  the  effectiveness  of 
efforts  on  their  behalf.  Instead  of  blaming  some  external  forces  for  the  problems 
students  have  in  school,  what  is  needed  is  a  better  understanding  of  how  the  conditions 
these  students  face  affect  their  ability  to  engage  in  the  educational  process  and  of  the 
ways  in  which  that  educational  process  contributes  to  students'  engagement  problems. 

Further,  we  need  research  and  development  studies  of  students  with  high  levels  of 
risk  factors  who  are  able  to  be  successful  despite  an  array  of  adverse  conditions.  From 
such  research,  we  may  be  able  to  learn  how  to  help  students  survive  a  hostile 
environment  In  line  with  this  type  of  approach,  we  need  to  look  at  the  qualities  and 
characteristics  of  programs  that  are  successful  with  various  kinds  of  high  risk  students 
to  determine  the  factors  that  work  to  engage  these  students  and  keep  them  in  school. 
We  already  know  from  the  literature  and  direct  experience  that  school  iailure  and 
truancy  are  two  prominent  risk  factors  for  urban  students.  We  need  to  discover  more 
effective  ways  to  get  students  to  attend  school  regularly  and  to  provide  them  with  the 
support  systems  they  require  to  stay  in  school. 

School  systems  need  to  reexamine  where  the  student  fits  into  the  pric\ues  of  the 
instructional  programs.  A  significant  risk  factor  for  many  students  may  be  the 
indifference  or  negative  reactions  of  teachers  and  administrators  to  students  who  do  not 
meet  their  expectations.  Many  students  who  drop  out  of  school  feel  as  if  everyone  was 
a  bit  happier  when  they  left. 
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Teacher  Training,  Retraining  and  In-Service 

One  of  the  most  critical  issues  for  urban  school  districts  is  the  need  for  well- 
trained  teachers  who  know  how  to  teach  in  urban  classrooms  and  who  are  committed  to 
all  of  the  students  they  serve.  The  current  pool  of  teaching  graduates  are  not  prepared 
to  teach  in  urban  schools  because  they  are  not  grounded  in  the  needs  and  conditions  of 
urban  schools,  nor  are  they  sufficiendy  acculturated  to  the  urban  school  environment 
which  would  be  helpful  in  the  adjustment  process  of  new  teachers.  New  teachers  are 
also  not  provided  the  tools  they  need  to  work  effectively  in  the  urban  school 
environment  giving  rise  to  considerable  frustration  and  feelings  of  incompetence. 
Understandably,  the  attrition  rates  among  new  teacher  are  quite  high  and  combined  with 
the  low  numbers  of  recent  graduates  willing  to  teach  in  the  central  cities,  a  real  threat 
to  urban  education  emerges.  An  important  step  in  meeting  the  need  for  teachers  well 
prepared  to  teach  in  urban  schools  is  to  forge  a  closer  collaboration  between  pre- 
service  teacher  training  institutions,  educational  support  organizations  such  as  regional 
labs,  and  urban  school  districts. 

Staff  development  is  a  critical  need  for  urban  districts.  We  need  to  develop,  in 
conjunction  with  teacher  education  professionals,  intensive  sustained  retraining  programs 
for  existing  staff.  Many  of  our  experienced  teachers  receive  little,  if  any,  assistance  in 
adapting  to  their  changing  student  populations  and  therefore,  have  difficulty  in  meeting 
their  students9  learning  needs.  Urban  students  represent  increasingly  diverse  cultures, 
language  and  personal  orientations.  The  growing  numbers  of  Limited  English  Proficient 
(LEP)  children  in  our  nation's  schools  pose  additional  challenges  for  urban  teachers. 
The  current  pre-  and  in-service .  teacher  training  programs  are  not  adequately  preparing 
our  teachers  to  meet  the  instructional  and  support  needs  of  language  minority  students, 
many  of  whom  drop  out  of  school  or  fail  to  fully  develop  their  capacities. 

Additionally,  principals  in  urban  districts  need  significant  retraining.  They  must 
become  effective  instructional  leaders  who  can  guide  and  support  their  faculties  in 
meeting  the  array  of  instructional  challenges  confronting  today's  schools.  Research  has 
shown  the  pivotal  role  the  principal  plays  in  developing  effective  schools.  Further 
development  is  needed  in  translating  this  research  into  specific  training  and  re-training 
programs  on  instructional  leadership  relevant  to  principals  in  the  urban  environment 
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Linking  and  Integrating  Social  Services  to  Meet  the  Needs  of  Urban  Youngsters 
Because  of  the  growing  numbers  of  poor  urban  school  youngsters,  the  school  is 
increasingly  required  to  be  an  advocate  to  ensure  students  are  receiving  a  range  of 
needed  community  and  social  services.    Often  these  services  are  essential  to  students9 
well  being  and  in  turn,  their  ability  to  apply  themselves  to  their  school  woik. 

Although  many  cities  have  significantly  improved  municipal  health  and  social 
services,  most  cities  lick  an  integrated,  comprehensive  approach  for  delivering  such  * 
services  to  vulnerable  or  needy  students  and  their  families.  Greater  coordination  of 
services  and  providing  these  services  in  the  school  should  be  considered  whenever 
possible.  More  creative  and  effective  models  for  the  coordination  and  delivery  of  social, 
psychological  and  health  services  need  to  be  developed 

Future  Roles  of  Regional  Labs 

Many  of  the  priority  concerns  expressed  above  are  not  new.  They  are  lingering 
concerns  which  still  lack  clarity,  understanding  and  solutions.  Unfortunately,  the  longer 
such  problems  persist,  the  more  intransigent  they  become.  In  the  following  section, 
suggestions  are  offered  regarding  the  role  education  laboratories  could  play  in  attacking 
these  persistent  problems. 

Gaining  Power  Through  Closer  Ties  with  the  Research  and  Development  Network 
The  problems  described  above  are  quite  complex  and  multidimensional.  Solutions 
will  require  the  acquisition  of  knowledge  through  research;  the  understanding  of  how 
these  problems  affect  and  are  addressed  by  school  systems;  the  development  of 
mechanisms  to  improve  the  structure  and  functioning  of  education  institutions.  In  other 
words,  there  is  plenty  of  work  for  all  aspects  of  the  research  and  development  network. 
We  have  tried  the  redundant  regional  lab  model,  that  is,  a  regional  entrepreneurial  lab 
for  "all  seasons  and  reasons. "  The  fact  is  that  while  regional  differences  do  exist  and 
labs  should  address  these  different  needs,  the  problems  we  face  in  educating  our 
students  have  great  similarities  from  one  region  to  the  next  By  recognizing  these 
commonalities  and  engaging  them  in  a  coordinated  manner,  the  research  centers  and 
education  laboratories  in  combination  with  other  institutions  with  similar  interests  can 
provide  a  formidable  capacity  no  single  set  or  subset  of  research  and  development 
agencies  could  duplicate.  An  integrated  R&D  agenda  for  labs  and  centers  that  focuses 
on  a  set  of  major  problems  should  be  developed.    The  specialized  centers  should  be 
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providing  much  of  the  knowledge  base  required  by  labs  to,  in  turn,  meet  the 
improvement  needs  of  school  districts  within  their  region.  Frequent  meetings  and 
reviews  of  progress  in  meeting  a  set  of  R&D  objectives  should  be  held  between  all  labs 
and  center  programs  to  reassess  their  contributions  and  make  changes  where  required. 

In  no  way  should  this  increased  collaborative  capacity  be  interpreted  as  infringing 
on  the  ability  of  labs  to  work  effectively  in  their  regions.  It  should  be  clear  from  the 
forgoing,  that  the  capacity  of  both  labs  and  centers  are  limited  in  their  ability  to  * 
effectively  address  the  education  needs  of  urban  eduction  centers  and  that  planful 
collaboration  is  essential  in  not  only  building  the  overall  capacity  of  the  research  and 
development  network  but  also  the  individual  capacity  of  each  member  of  that  network. 

Emphasize  Technical  Assistance  Problem-Solving  Role 

Regional  labs  should  offer  more  hands-on  sustained  technical  assistance  to  all 
urban  school  districts  within  their  region.  At  present,  much  of  the  direct  help  to 
schools  is  provided  on  a  fee-for-service  basis,  unless  the  requested  assistance  is  a  part 
of  a  lab's  pre-set  research  and  development  program.  It  would  even  be  conceivable  for 
each  lab  to  station  some  staff  members  in  local  school  systems  who  would  offer  direct 
assistance  as  well  as  mobilize  overall  lab  involvement  when  appropriate. 

The  primary  function  of  this  direct  help  to  urban  districts  would  be  to  translate 
state-of-the-art  research  into  actions  and  plans  for  program  improvement  This 
approach  would  allow  labs  and  their  personnel  to  provide  a  sustained  problem-solving 
effort  over  time.  From  such  efforts*  the  labs  would  gain  a  first-hand  understanding  of 
the  usefulness  and  effectiveness  of  research  as  a  vehicle  for  improvement  of  practice. 
This  approach  would  have  die  further  advantage  of  providing  labs  more  specific 
knowledge  about  school  districts'  capacities  and  the  particular  ways  in  which  labs  can 
be  most  helpful  to  schools  in  their  program  improvement  endeavors. 

It  is  recognized  that  this  approach  runs  somewhat  counter  to  the  current  policies 
and  practices  for  labs.  It  must  be  emphasized  however,  that  while  providing  assistance 
through  state  agencies  may  be  more  efficient,  the  resultant  effect  is  likely  to  continue 
to  be  inadequate  given  the  extent  of  problems  in  urban  schools.  Given  limited  resources 
labs  should  initially  work  with  urban  systems  needing  the  greatest  help.  State  agencies 
should  continue  to  provide  whatever  assistance  they  can  along  with  the  coordinated  lab 
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effort  State  agencies  can  also  be  helpful  in  applying  the  knowledge  gained  in  what 
proves  to  work  in  one  urban  setting  to  others  needing  similar  assistance.  In  other 
words  state  agencies  must  continue  to  be  an  important  pan  of  the  overall  collaborative 
effort  to  improve  the  capacity  of  urban  schools. 

Building  School  System  Capacity 

Anofher  important  role  for  the  labs  is  to  provide  more  ongoing  technical  assistance 
to  enable  urban  school  districts  to  conduct  their  own  applied  research.  Urban  school 
systems  also  need  technical  assistance  from  labs  in  conducting  meaningful  planning, 
using  forecasting  and  strategic  planning  approaches.  Labs  can  aid  such  planning  efforts 
by  providing  research  and  analysis  used  in  dealing  with  similar  situations  in  other  school 
districts. 

Program  decision  makers  need  training  on  how  to  systematically  use  planning  and 
research  efforts  as  an  aid  in  reviewing  programs  and  making  allocations.  A  further 
capacity  that  needs  to  be  developed  to  aid  the  planning  and  decision-making  process  is 
the  development  of  program  evaluation  capacities  at  the  local  level.  A  critical  need 
among  urban  school  districts  is  to  develop  an  in-house  ability  to  conduct  formative 
evaluation  of  programs  and  services. 

Capacity  building  through  technical  assistance  also  is  needed  in  developing  the  next 
generation  of  comprehensive  K-12  curricula  and  instructional  systems.  This  would 
require  a  heavy  emphasis  on  working  in  school  districts  to  expand  their  capabilities  to 
carry  on  continuous  curriculum  improvement  efforts  on  their  own.  The  next  generation 
of  curriculum  and  instructional  systems  will  have  to  be  more  responsive  to  the  diverse 
learning  styles  of  the  mix  of  urban  students  and  will  have  to  address  the  critical  need 
to  increase  students9  higher  order  skill  development  particularly  in  the  areas  of  problem 
solving  and  critical  thinking. 

Developing  More  Effective  Pre-Service  and  In-Service  Training  for  Teachers 
Another  crucial  role  for  the  labs  is  to  translate  the  research  on  effective  teaching 

in  urban  settings  into  actual  training  modules  for  teachers  in  training  as  well  as  for 

teachers  needing  retraining. 
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Labs  need  to  become  a  part  of  efforts  designed  to  forge  linkages  between  teacher 
training  institutions  and  urban  school  districts.  Labs  should  provide  technical  assistance 
to  universities  in  planning  joint  projects  with  urban  school  districts  designed  to  improve 
the  instructional  skills  of  new  as  well  as  existing  teachers.  Labs  should  provide  the 
leadership  in  their  regions  to  convene  teacher  training  experts  and  leaders  of  urban 
districts  to  help  assess  needs  and  to  examine  existing  programs  that  show  promise  and 
on  the  basis  of  the  foregoing  analysis,  develop  improved  programs 

Work  on  Developing  Effective  Central  Office  and  School  Management  and 
Organization  Structures 

Currendy,  there  is  significant  interest  in  large  urban  districts  in  restructuring  and 
developing  a  more  effective  central  office.  Labs  can  play  an  important  role  in  providing 
the  research  and  experience  base  to  school  systems  that  would  help  them  design  and 
bring  about  these  organizational  changes  in  ways  that  would  meet  their  needs  and  be 
more  effective  in  solving  their  organizational  problems. 

The  need  for  more  responsive  and  more  efficient  management  structures  provides 
the  opportunity  for  education  laboratories  to  provide  direct  technical  hands-on 
assistance  to  school  districts  in  developing  their  restructuring  plans  as  well  as  providing 
formative  evaluation  guidance  in  assessing  the  effectiveness  of  these  plans  over  time. 
Feedback  of  this  kind  will  be  extremely  important  in  facilitating  these  important 
organizational  changes. 

Another  area  in  which  lab  assistance  could  be  helpful  is  in  the  examination  of 
court  involvement  in  the  management  of  desegregation  programs.  A  systematic  inquiry 
into  this  area  could  help  to  inform  courts  and  school  districts  of  the  potential  effects 
of  court-mandated  actions  and  allocations  of  school  district  resources  based  on 
experience  and  accumulated  wisdom.  These  inquiries  should  also  assess  more  effectively 
the  educational  gains  students  make  as  a  result  of  the  implementation  of  different  plans. 

Linking  Urban  School  Districts  With  Other  Community  Agencies  Supplying  Support 
Services  to  Students  and  Families 

Education  labs  should  also  take  the  initiative  in  convening  school  district  and 

political  leaders  of  cities  and  regions  to  explore  effective  ways  of  reconfiguring  support 

service  delivery  to  high  risk  students,  dropouts,  teenage  mothers  and  youngsters  living 
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in  extreme  poverty  or  under  extremely  adverse  conditions.  The  coordinated  delivery  of 
support  services  to  students  is  not  only  critical  to  their  welfare  but  to  dieir  ability  for 
school  success.  Labs  could  work  with  education  research  centers  to  commission  action 
research  to  study  the  intermediate  aiid  long-term  effects  of  various  strategies  for 
integrating  the  delivery  of  social  and  educational  services. 

Conclusions 

The  challenge  for  urban  public  schools  from  this  point  to  the  twenty-first  century 
will  be  to  demonstrate  their  ability  to  provide  the  best  education  for  all  children.  If 
schools  fall  very  short  of  this  goal,  the  nation  will  come  to  depend  less  on  public 
education  and  increasingly  will  be  receptive  to  alternatives  which  may  not  share  the 
commitment  to  providing  quality  educational  opportunities  for  each  child  regardless  of 
economic  circumstance.  We  have  worked  too  hard  and  invested  too  much  in  the  concept 
of  high  quality  universal  public  education  to  allow  the  demise  of  this  noble  experiment 
in  democracy.  This  failure  would  have  grave  consequences  for  the  principles  of  equality 
and  equity  which  we  have  honored  as  a  nation  for  so  long. 

Education  labs,  as  described  here,  have  an  important  role  to  play  in  the 
improvement  of  urban  schools.  To  do  this,  however,  the  network  of  education  research 
and  development  institutions  must  work  closely  together  to  forge  a  more  purposeful  and 
strategic  force  to  help  bring  about  needed  changes.  Through  the  concerted  development 
of  new  knowledge  and  the  strategic  application  of  that  knowledge  for  program 
improvement,  the  contributions  of  this  research  and  development  network  could  be  very 
significant 

With  bold  new  initiatives  that  combine  to  strengthen  the  delivery  of  effective 
instructional  services,  urban  students  will  acquire  the  skills  necessary  to  meet  the 
competitive  challenges  that  await  them.  Provided  with  opportunities  to  employ  their 
skills,  urban  youngsters  will  be  able  to  take  the  forward  steps  that  this  nation  has 
grown  to  expect  from  each  succeeding  generation. 

Although  the  challenges  are  great,  all  concerned  must  assist  in  the  renewal  of  our 
urban  public  schools.  We  must  develop  a  positive,  creative  force  in  our  schools, 
approaches  to  address  problems  realistically  and  improvement  strategies  based  on 
research  and  experience  that  will  produce  not  minimally  but  maximally  effective  schools. 
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Excellent  public  schools  are  a  realistic  goal  for  every  community.  Meeting  that  goal, 
however,  will  require  the  determination  and  assistance  of  many  parties.  The  regional 
labs  and  centers  can  play  a  major  role  in  realizing  this  most  worthy  objective. 
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School  and  Classroom  Improvement  in  two  European  Countries 

T.   Neville  Postlethwai te 
University  of  Hamburg,  FRG 

Research  activities  in  education  take  place  in  universities, 
teacher  training  colleges,   in  special  research  institutes,   and  in 
governmental  units  either  at  the  central  Ministry  or  regional 
level.  The  themes  or  issues  being  researched  are  sometimes  given 
by  the  government  and  sometimes  are  initiated  by  individual 
institutes  or  researchers.   Such  research  typically  includes  the 
evaluation  of  the  system  for  participation  rates  and  achievement 
levels ,   investigation  of  the  sequence  of  concepts  and  the 
complexity  of  language  used  in  different  grade  groups,  selection 
techniques,  methods  of  instruction  and  the  like. 

Development  activities  in  education  are  usually  undertaken 
in  the  same  institutional  settings  as  research.   However,  develop- 
ment activities  often  occur  at  the  school  or  district  level. 
Development  is  primarily  in  the  area  of    curriculum  materials  but 
also  in  the  realms  of  special  issues  such  as  developing  the 

be?t"  way  of  organizing  small  or  isolated  schools,  developing 
training  courses  for  principals,  developing  teaching-learning 
strategies,  developing  appropriate  technology  and  so  on. 

R  and  D  activities  are  undertaken  for  information  required 
for  decision  making  at  different  levels  of  the  system:  national, 
state,  district  or  school   (Ross  and  Postlethwai te ,   1988).   In  some 
research,   it  is  possible  to  generate  results  that  are  of  use  at 
all  levels.  However  in  general,   it  is  useful  to  be  aware  of  the 
different  levels  for  which  results  are  being  produced,  irrespec- 
tive of  the  level  at  which  the  activities  are  initiated,  before 
planning  a  project. 

A  final  step  is  the  dissemination  of  knowledge  and  tech- 
niques to  the  different  levels  of  the  system  for  which  such 
knowledge  is  appropriate.  Of  particular  interest  in  this  paper 
is  dissemination  to  the  school  level  which  results  in  school 
and  classroom  improvement.   This  last  step  is  dependent  on  the 
appropriateness  of  the  research  and  development  that  has  taken 
place.   Has  it  been  well  conceptualised  in  the  first  place?  Is  it 
responding  to  a  known  need?  If  not,   it  might  well  be  perceived  as 
only  an  academic  game  and  unrelated  to  the  needs  of  the  schools. 
Do  the  schools  have  a  mechanism  to  help  determine  the  type  of 
work  which  R  and  D  centers  should  undertake? 

Much  has  been  written  about  the  links  between  educational 
research,   educational  policy-making,   and  the  implementation  of 
research  results   (Weiss,   1979,  Husen  and  Kogan,   1984)  and  of  the 
enormous  complexity  of  these  relationships.  Much  has  also  been 
written  on  the  institutional  inertia  or  the  resistance  to  change 
that  is  built  into  institutions.  Many  persons  have  a  vested 
interest  in  the  status  quo.   In  order  to  bring  about  change,   it  is 
q        necessary  to  convince  those  affected  that  the  change  is  in  their 
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interest.  Communication  is  a  necessary  but  not  sufficient  con- 
dition to  bring  about  change  (cf.  Husen,   1968).  I  assume  that 
readers  know  of  these  discussions  and  will  not  enter  such 
debates.  Rather,   J  will  describe  the  steps  taken  in  two  European 
countries  (in  alphabetical  order  Hungary  and  Sweden)   to  improve 
schools  and  classrooms • 

Context. 

Education  as  well  as  educational  R  and  D  and  implementation 
take  place  within  a  social-political-economic  context.   It  is, 
therefore,  desirable  to  mention  a  few  basic  facts  about  each 
system.  All  three  countries  have  small  populations.   Hungary  has 
about  11  million  people,   the  Netherlands  about   14  million,  and 
Sweden  about  8  million . 

Some  basic  facts 

Hungary  has  compulsory  education  from  6  to  16  years  of  age. 
All  students  are  in  a  unified  school  system  split  into  4  grades 
of  basic,  4  grades  of  general  lower  secondary  schools,  and  then, 
from  the  age  of  14,  either  an  upper  secondary  school  (academic), 
vocational  secondary  school  or  trade  school.  Forty  percent  of  an 
age  group  is  enrolled  in  Grade  12. 

Sweden  has  compulsory  schooling  from  the  age  of  7  years  to 
16  years.  Ninety  percent  of  an  age  group  is  enrolled  in  school  at 
Grade  11  but  this  declines  to  30  percent  at  Grade  12.   There  is  a 
unitary  comprehensive  school  system  up  to  age  16  and  thereafter 
2,   3  or  4  year  tracks  in  arts  and  social  subjects,   economics  and 
commercial  subjects,  scientific  and  technical  subjects,  academic 
general,   and  vocational. 

In  Sweden,   teachers  are  paid  well  -nove  the  GNP  per  capita 
whereas  in  Hungary  the  teachers  are  only  paid  about  80  percent  of 
the  GNP  per  capita.  There  are  currently  teacher  demonstrations 
and  strikes  in  Hungary  for  more  pay.  Recently  a  new,  independent 
trade  union  for  teachers  was  established* 

Both  countries  have  relatively  high  achievement  in 
Science  ( IEA,   1988,  p.   42)  and  this  was  one  reason  for  selecting 
these  school  systems.  The  differences  between  schools  in 
achievement  as  a  proportion  of  the  differences   (variance)  among 
students  varies  considerably.  At  Grade  8/9  level  it  is  29  percent 
for  Hungary  and  8  percent  fnr  Sweden.   Thus,   from  one  point  of 
view  equality  of  opportunity  has  been  achieved  most  in  Sweden  and 
only  to  a  limited  extent  in  Hungary. 

Centralisation/Decentralisation 

Hungary:   In  1948,   a  Stalinist  form  of  socialism  was  established. 
Given  the  form  of  traditional  Prussian  administration  which  h*d 
existed  before  this  time,   the  result  was  extreme  centralisation. 
For  education,   this  mearvt  the  central  administration  of  all 
schools  and  a  central  curriculum  ("curriculum  is  the  lawM  was 
one  slogan  of  the  times). 
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At  the  end  of  the  1060s  and  in  the  1970s  there  were 
increasing  moves  to  establish  a  'new  deal*   (meaning  decentrali- 
sation) throughout  all  aspects  of  the  society.  The  reform  in 
education  tended  to  follow  other  reforms.   In  1985     new  legis- 
lation in  education  came  from  the  top  down.  The  main  aims  of  the 
legislation  were  to  decentralise  administration  and  poUcy  and 
Snr!  !  A*™  PafticlPation  and  innovation  at  the  school  level. 
More  and  more  liberty  is  given  to  the  schools  in  matters  such  as 

IT^Zk  ttr^r1  Pr0gran8'   SCh°01  teaching" 

^nitUr'p'V8  divided  into  20  aunties  of  which  one  is  the 
nlft!    *u  c°"nty  has  a  department  of  education.  Traditio- 

nrltL  t      °?unty  councils  are  strongholds  of  bureaucracy  and 
orthodox  political  views.   In  order  to  counterbalance  these  county 

;;AJV"?  C°Unty  educati°™l  institutes  were  set  up  and 
staffed  by  former  inspectors  of  education  and  persons  from  in- 

semngs        ning  inStitUteS'   Fi*ure  1  Presents  the  old  and  new 
Figure  1:  Old  and  new  settings  in  Hungary 
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IJC *ducational  institutes  are  becoming  the  "extended 
?n!n* V      «overnB,ent*»  reform  policy.  These  educational 
institutes  are  a  major  key  to  school  improvement. 

„   .  .Thefe  are  three  central  institutes  of  educational  research 

eloPment:  the  National  Institute  for  Education  (curriculum 
development     evaluation  research,   school  experiments),  the 
Educational  Research  Institute  (macro  level  research  on  educa- 
tional needs  of  the  society,   planning  of  education  (system-level, 
economxcs),  tertiary  education  etc.)  and  the  National  XnltiStI 
^nEJUCai10nal  technology.  It  is  rare  for  universities  and 
colleges  to  conduct  empirical  research  in  education.  There  is  an 
automatic  dissemination  (publications,  seminars,  special 
meetings)  of  the  results  of  the  R  and  D  work  at  the  central  level 

eacJ  of  th     I  KdU?ati°naJ  In8titutea«  These,   in  turn,   deal  with 
each  of  the  schools  in  their  areas  both  through  inspectors' 
visits  and  compulsory  in-service  training. 

The  Hungarian  system  has  a  core  curriculum  and  relatively 
good  pre-service  training.  As  we  shall  see  later  it  also  has  a 
good  communication  system  from  top  to  bottom  and  bottom  to  top  of 
the  administrative  system. 
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Sweden:  Sweden  has  a  constitutional  monarchy  with  parliamentary 
representative  democracy  written  into  its  constitution.  Education 
has  a  high  profile  within  the  country.  Each  of  the  last  three 
prime  ministers  in  Social  Democratic  governments  have  also  been 
education  ministers  before  becoming  prime  minister.  There  is 
political  stability.  Between  1932  and  1976  the  Social  Democrats 
were  in  power,   practically  without  interruption.  Unemployment  is 
low  and  material  prosperity  high. 

Figure  2  represents  the  levels  in  the  administration  at 
which  various  categories  of  R  and  D  work  are  carried  out. 

Figure  2:  Administrative  levels  in  Sweden  at  which  R  and  D  work 
is  conducted. 
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Above  the  diagram  is  the  Parliament  and  Ministry  of 
Education.  It  is  Parliament  which  defines  the  overall  goals  and 
guidelines  for  education.   It  issues  regulations  and  Ordinances 
and  tfi«es  instructions  to  the  National  Board  of  Education  (NBE), 
the  ..1  County  Education  Committees  (CECs),   the  Municipal 
Education  committees  and  local  education  authorities  (LEA).  The 
NBE  is  the  national  authority  for  primary  and  secondary  schooling 
(and  also  adult  education).  The  NBE  must  ensure  that  the  goals 
and  guidelines  of  the  Parliament  and  Ministry  are  put  into  effect 
and,   if  necessary,  revised.  The  CECs  supervise  schools  in  the 
county,  distribute  state  grants,  and  support  and  encourage  school 
development  work.  The  NBE  and  CECs  together  have  the  task  of 
ensuring  the  improvement  of  schools. 

Municipal  Education  Committees  and  Local  Education 
Authorities  have  the  overall  responsibility  for  the  actual  school 
work.  Schools  and  adult  education  are  predominantly  a  municipal 
responsibility  and  one  of  the  largest  items  on  the  municipal 
budget.  The  Municipal  Education  Committee     decides  school  policy. 
This  school  policy  is  then  put  into  effect  by  the  Local  Education 
Authority  and  its  officials.  However,   the  country  has  a  national 
curriculum  for  schools  at  all  levels,  national  testing  programs 
and,  more  recently,  a  national  assessment  program. 
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Each  school  is  directed  by  a  principal,  but  planning 
involves  consultations  with  staff  and  pupils  and  -  in  the  case  of 
compulsory  schools  -  with  the  parents  as  well.  Teacher  unions  are 
strong . 

The  Swedish  school  systea  rests  on  the  principle  of 
guaranteeing  all  children  equivalent  basic  education, 
irrespective  of  residential  locality  or  parental  income.  This  is 
why  goals  and  guidelines  and  the  curriculum  are  decided  by  the 
Riksdag  and  why  there  is  a  national  school  administration. 

The  costs  for  compulsory  and  upper  secondary  education  is 
shared  roughly  equally  between  the  State  and  the  Municipalities. 

In  1988  the  NBE  had  approximately  6  million  US  dollars  for 
and  D  work  (for  research,  central  development  work  including 
curriculum  development  and  revision  of  materials,  and  the 
dissemination  of  information  about  R  and  D) .  'me  CECs  had  about  3 

?il  J?!    k  J*1"!  aJto*ether  to  disseminate  local  development  work. 
The  LEAs  had  about  60  million  US  dollars  for  in-service  teacher 
training,   local  development  work  in  general  and  some  specifically 
ear-marked  development  activities  in  schools. 

Figure  2  shows  the  bodies  that  initiate,  undertake  and 
follow  up  the  work.  There  are  several  points  which  should  be 
mentioned.  The  NBE  has  a  mechanism  for  canvassing  ideas  for 
research  from  schools  via  LEAs  and  CECs  as  well  as  from 
universities  and  from  unions  including  teacher  unions  and  parent 
associations.  The  NBE  sets  the  final  priority  for  its  funding. 
However,  the  CECs  and  LEAs  can  also  initiate  development  work  for 
school  improvement  on  their  own. 

Ths*e  are  no  research  institutes  for  education  outside  the 
universities  and  schools  of  education,  nor  are  there  any  separate 
institutes  for  evaluation  and  test  construction.  According  to  the 
Sweuish  research  policy,   research  should  be  carried  out  within 
the  universities  and  rely  on  the  scientific  competence  there. 
This  means  that  the  universities  are  the  body  for  basic  training, 
research  training,  basic  research,  commissioned  research  as  well 
as  pre-service  and  in-service  teacher  training. 

Researchers  from  many  disciplines  are  engaged  in  educational 
research  and  development  work:  pedagogy,  sociology,  psychology, 
political  science,  natural  sciences,   humanities,  linguistics,  and 
foreign  language  departments.  Departments  of  education  in  parti- 
cular are  engaged  in  evaluation  activities  such  as  the  construc- 
tion of  the  standardized  tests  used  in  compulsory  and  upper 
secondary  education  and  in  the  Swedish  national  assessment 
prograome.  TY a  final  decisions  concerning  standarized  tests  and 
the  instrumei.c  used  in  the  national  assessment  programme  are 
taken  by  NBE,  however. 

There  is  a  core  curriculum  laid  down  centrally  and  much  , 
effort  is  given  to  INSET  (In-service  training  of  teachers). 
However,   INSET  is  built  on  national  priorities  to  which  LEAs 
adhere  and  this  is  a  powerful  instrument  for  dissemination.  INSET 
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consisting  of  five  mandatory  study  days  per  year  *s  compulsory 
and  it  is  the  responsibility  of  the  school  leaders  (principals). 
From  1989  all  teachers  in  the  compulsory  school  ( grundskolan )  are 
expected  to  participate  in  a  2-3  week  course  aimed  at  deepening 
the  understanding  of  educational  goals.  Class-teachers  are 
further  expected  to  participate  in  INSET  about  mother-tongue  (2-3 
weeks),  and  mathematics  and/or  Science  (5  weeks).  This  program  is 
planned  to  be  completed  for  all  teachers  within  10  years. 
Thereafter,  any  teacher  can  take  a  one  term  (5  months)  INSET 
course  in  a  subject  or  subject  area  of  his  or  her  own  choice. 

Questions  to  be  answered 

1.  How  is  R  and  D  for  school  improvement  produced  or  o!~tained? 

R  and  D  is  determined  nationally  but  conducted  at  central, 
regional,  and  school  levels  in  Hungary.  The  total  amount  of  money 
available  is  approximately  0.5  percent  of  the  primary  and 
secondary  school  national  budget. 

One  central  committee  decides  on  the  distribution  of  funds 
for  R  and  D.  The  committee  has  15  members.  The  chairperson  is  a 
political  appointee  and  he/she  then  chooses  14  other  persons, 
typically  professionals.  This  committee  solicits  ideas  for  R  and 
D  from  researchers  (at  universities  and  at  the  three  national 
institutes  concerned  with  education:   the  National  Institute  of 
Education,   the  National  Educational  Research  Institute,  and  the 
National  Institute  for  Educational  Technology),   from  the  County 
Departments  of  Education  and  Educational  Institutes,  and  from 
schools.  Most  submissions  come  from  the  researchers  but  about  one 
third  of  submissions  come  from  schools.  Only  rarely  do 
submissions  come  from  the  county  level. 

The  criteria  used  for  determining  priorities  are: 

1.  Social    -elevance  (in  this  case  projects  likely  to  help  the  new 
educational  reform) ; 

2.  Quality  of  proposed  research  methodology; 

3.  Prestige  of  researcher  or  research  group. 

Experts  -  and  in  some  cases  even  members  of  the  committee  - 
write  an  expert  appraisal   (Gutachten)  of  each  submission  and  this 
is  then  reviewed  by  the  committee.  It  is  of  interest  that  the 
local  schools  receive  slightly  more  than  one  third  of  the  money 
available  (because  there  are  relatively  many  experimental 
schools,   run  by  alternative  programmes). 

Two  examples  of  school  development  projects  are  given.  In 
one  school  three  teachers  applied  for  money  to  develop  and 
evaluate  (using  empirical  methods)  in  several  schools  an 
integrated  social  studies  curriculum.  They  undertook  the  develop- 
ment work.  The  curriculum  materials,  after  several  try-outs  and 
revision  were  approved  by  the  National  Institute  of  Education 
(which  must  approve  any  curricular  materials).  More  and  more  r 
schools  are  using  this  curriculum  and  materials.  There  was  a 
successful  similar  project  in  mathematics.  A  second  example  is 
that  one  teacher  proposed  a  project  for  a  special  music  school 
(k  la  Wiener  Sangerknaben ) .  The  project  is  now  under  development. 
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It  is  to  be  noted  that  the  school  level  R  and  D  is  mostly 
development/innovation  but  does  use  some  empirical  research 
methods  in  the  small  scale  try-out  phase.   It  is  the  central 
institutes  that  tend  to  conduct  the  more  research  oriented 
studies . 

As  can  be  seen  from  Figure  2  presented  earlier,   in  Sweden 
the  NBE  determines  all,  or  nearly  all,  research  projects  and  sub- 
contracts the  conduct  of  these  projects  to  the  universities.  This 
research,  however,   is  not  Vie  only  educational  research  conducted 
in  Sweden.  A  cautious  guess  would  be  about  60  percent.  The  rest 
is  financed  from  other  sources. 

However,  much  development  work  -  apart  from  the  central 
curriculum  development  work  which  is  undertaken  by  a  combination 
of  the  National  Board  of  Education  and  the  County  Education 
Committees  (CEC)  -  is  undertaken  at  the  CEC  and  LEA  levels. 

2.  How  is  R  and  D  for  school  improvement  disseminated? 

In  Hungary,   this  is  done  through  the  teacher  newspaper,  the 
ordinary  press,  teacher  journals,  and  leaflets  which  are  produced 
by  the  central  authorities  and  distributed  via  the  county 
education  departments  to  the  county  institutes  and  to  the 
schools.  There  is  considerable  doubt  about  the  effectiveness  of 
the  written  form  of  communication.  Oral  communication  through 
INSET  and  the  county  inspectors  is  found  to  be  more  effective. 

In  Sweden  the  most  important  channels  through  which  R  and  D 
results  can  be  disseminated  are: 

.  commentary  material  linked  to  the  curriculum 

.  other  service  material  for  the  schools 

.  information  for  school  leaders 

.  books  from  research  projects,  published  either  commercially  or 
-  which  is  more  common  -  through  NBE  at  low  or  no  cost  for  the 
schools  and  teachers 

.  information  sheets  from  research  projects  written  directly  for 
teachers 

.  reports  from  research  projects,  regional  and  local  developmenl 
projects  and  from  central   National)  evaluation  studies  and 
from  curriculum  development  work 

•  articles  in  teacher  journals. 

Within  NBE  there  exists  a  data  base  in  which  basically  all 
the  material  mentioned  above  is  available  on  line  for  schools. 
The  reports  etc.  can  be  borrowed,  bought  or  obtained  free  of  r 
charge  from  either  the  NBE,  CEC  or  libraries. 
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The  potentially  most  powerful  channel  for  dissemination  of 
and  D  results  is  the  commentary  materials  linked  to  the 
national  curriculum.  The  Riksdag  has  stated  that  NBE  is  respon- 

k     i-i        8  continuous  development  of  the  curriculum  and  that  it 
should  support  schools  with  commentary  material  that  should  be 
based  on  research  and  development  work.   It  is  however  not 
mandatory  for  the  schools  to  buy  these  materials,  nor  are  they 
mandatory  for  the  teachers  to  3tudy. 

Dissemination  of  R  and  D  results  in  writing  without  any 
defined  connection  with  other  activity  has  proved  to  be  a  weak 
instrument  for  school  development  and  improvement.  Recently,  a 
study  was  undertaken  of  teachers  in  the  compulsory  school 
(focussing  on  their  values  and  beliefs  about  the  teaching 
profession  as  well  as  about  the  gaps  between  what  they  want  and 
what  they  get  to  help  them  in  their  work).  The  written  material 
mentioned  above  (and  is  was  linked  to  the  curriculum)  was 
mentioned  only  by  very  few  as  an  important  channel  for  getting 
Knowledge  about  the  curriculum  and  about  teaching  methods. 
Teachers  seem  to  rely  solely  or  almost  solely  on  oral  communi- 
cation with  colleagues  and  on  the  study  days  and  other  in-service 
activities  for  their  own  professional  development. 

3.  Assuming  that  simply  making  knowledge  about  R  and  D  findings 
available  through  written  dissemination  is  not  sufficient  to 
gain  their  use,  what  further  steps  are  taken? 

In  both  countries  it  would  appear  that  written  communication 
is  insufficient. 

In  Hungary  the  County  Institutes  of  Education  organize 
teacher  meetings.  R  and  D  persons  are  invited  to  give  talks  and 
persons  from  the  County  Institutes  also  give  talks.  The  National 
Institute  of  Education  organizes  central  meetings  of  inspectors 
to  inform  them  of  R  and  D  and  to  arrange  for  them  to  pass  them  on 
to  school  principals  and  teachers  as  they  visit  each  school. 

The  County  Institutes  of  Education  organize  different  expert 
teams  in  order  to  facilitate  the  dissemination  of  information;  In 
a  typical  setting  curriculum  experts,  advisers,  teaching  aid 
designers,  evaluators,  curriculum  experts  and  teachers  are 
involved.  Where  teachers  join  in  development  work  activities  they 
may  receive  more  pay.   These  teams  are  organized  on  a  temporary 
ba.ais.  it  is  too  early  to  judge  the  effectiveness  of  this  means 
of  dissemination  partly  because  of  their  newness  and  also  because 
?uoi£n??C1-     c?nstraincs.  The  main  avenue  for  dissemination  is 
INSET  (In-Service  Teacher  Training)  as  organized  by  the  County 
Educational  Institutes. 

One  of  the  main  problems  is  to  change  teachers'  negative 
attitudes  towards  reform.  After  years  and  decades  of  "conforming" 
it  is  difficult  for  teachers  to  have  new  and  bold  ideas  and  to 
express  them.  It  is,  however,  the  personal  contact  with  teachers 
and  the  oral  dissemination  of  ideas  and  R  and  D  results  which  is 
expected  to  have  more  influence  than  other  forms  of 
dissemination . 
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One  major  avenue  which  should  serve  dissemination  purposes 
is  pre-service  teacher  training.   In  Hungary,   the  pre-service 
teacher  training  institutions  are  conservative  and  tend  to  act  as 
a  brake  rather  than  an  accelerator.  They  view  their  main  task  as 
that  of  producing  good  subject  matter  knowledge  in  the  future  ^ 
teachers  and  pay  little  attention  to  the   'pedagogical  knowledge'. 
They  ao  not  reject  the  idea  of  reform  but  neither  do  they  support 
it.  Th.„s,  much  remains  to  be  done  in  the  area  of  dissemination 
for  the  successful  application  of  R  and  D  for  school  improvement . 

In  Sweden  in-service  education  is  also  the  major  vehicle  for 
school  improvement.   In-service  teacher  training  is  the  joint 
responsibility  of  the  National  Board  of  Education  and  the 
National  Board  of  Universities  and  Colleges.  A  substantial  part 
of  the  in-service  teacher  training  is  given  within  universities 
and  schools  of  education  although  an  increasing  amount  of  it  is 
provided  for  by  the  municipal  education  authorities.  State  grants 
for  local  development  work  in  schools  are  given,  stating  that  at 
least  60  percent  but  not  more  than  80  percent  should  be  used  for 
in-service  teacher  training.  To  this  should  be  added  that  five 
'study  days"  per  year  are  compulsory  for  all  teachers. 

Priorities  as  to  tfie  main  areas  in  which  state  grants  are 
given  to  in-service  teacher  training,  are  stated  by  NBE .  During 
the  eighties,  a  shift  in  policy  for  INSET  has  meant  that  more 
emphasis  has  been  put  on  the  general  goals  for  schooling,  above 
all  on  what  is  called  "The  school  is  for  everybody"  and  as  a 
consequence  of  that,  emphasis  on  means  and  methods  for  pupilc 
that  need  extra  support.  This  has  been  done  at  the  expense  of 
subject-matter  INSET  except,  above  all,  computers  in  education 
and  in  later  years  (as  a  result  of  the  IEA-mathematics  study  from 
1980)  on  mathematics. 


These  national  INSET  priorities  have  been  very  powerful  as 
instruments  for  the  content  of  INSET.   It  can  be  shown  that  these 
INSET  courses,  both  locally  arranged  ones  and  those  given  through 
universities  have  had  an  impact  on  teacher  attitudes  and  on  the 
acceptance  from  more  and  more  teachers  of  the  very  idea  of  "A 
school  for  everybody".  This  is  especially  true  for  upper 
secondary  school,  where,  it  must  be  admitted,   there  still  remains 
most  to  be  done  in  this  respect. 

In  a  study  of  the  written  materials  used  in  these  (academic) 
INSET  courses  it  could  also  be  shown  that  most  of  the  mandatory 
literature  consisted  of  research  reports,  many  of  which  were 
summaries  of  results  from  NBE-financed  research  projects.  An 
interesting  pattern  could  be  seen  in  that  the  materials  were,  to 
a  very  large  extent,   "local".  Each  university  defined  what  was 
presented  at  INSET  courses  according  to  the  research  carried  out 
within  that  particular  university.   In  practice  this  means  that 
although  the  problem  areas  are  national   (the  titles  of  the  INSET 
courses  are  identical)  the  actual  content  of  the  courses  given 
and  the  policy  and  philosophy  transmitted  could  vary  substan-' 
tially.  This  is,   however,  more  true  for  the  subject-oriented 
INSET  than  for  INSET  dealing  with  the  general  goals  for 
schooling . 
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Thus  INSET  built  on  national  priorities  to  which  local 
educational  authorities  adhere,  can  be  powerful  instruments  for 
the  dissemination  of  research  and  development  results. 

There  are  five  mandatory  study  days  for  schools  and  teachers 
per  year.  It  has  been  shown  that  compulsory  school  teachers 
regard  them  as  very  important  information  channels  especially  for 
curriculum  matters  and  for  teaching  methods.  Their  importance  has 
not  been  recognised  until  recently. 

The  study  day  programme  is  usually  the  responsibility  of  the 
school  leaders.  The  school  leaders'   importance  as  change  agents 
m  school  is  widely  recognized.  Without  a  strong  pedagogical 
leadership  and  change-oriented  school  leaders,  'bureaucratic 
cementing'  would  tend  to  take  place  in  Swedish  schools.  Thus,  the 
form  and  content  of  the  study  days  will  be  studied  intensely 
during  the  year  to  come.   If  more  of  research  and  development 
results  could  form  the  content  of  the  study  days,  a  new  and 
potentially  powerful  channel  could  be  opened  up. 

According  to  the  yearly  reports  given  from  research 
projects,  researchers  are  often  engaged  in  study  day  programmes. 
Researchers  are  also  very  often  engaged  in  the  INSET  courses 
given  by  the  universities,   as  can  be  seen  from  the  above. 

It  should  be  mentioned  that  the  INSET  programmes  at  the 
universities  are  run  by  a  special  body,   linked  to  the  university 
but  formally  belonging  to  NBE.  The  NBE  hands  in  the  budget 
requests  to  Government  and  the  Riksdag  for  INSET  (and  gives  the 
INSET  priorities  as  well).  r 

As  has  already  been  mentioned,   from  1989  INSET  will  be 
compulsory  for  all  teachers  in  the  comprehensive  school.  The 
educational  authorities  want  to  mak-  sure  that  those  teachers 
who  received  their  basic  training  before  1988  (as  class-teachers 
for  grades  1-3  or  4-6  or  as  subject  teachers  for  grades  7-9) 
should  acquire  the  competence  to  be  teachers  in  grades  1-7  or 
in  grades  4-9. 

An  important  role  in  having  R  and  D  implemented  is  played 
by  school  leaders  (school  principals  and  deputy  principals).  As 
has  been  mentioned,   principals  -  or  with  a  broader  term  -  school 
leaders  and  school  leadership  are  vital  for  the  development  and 
improvement  of  schools  and  instruction.   Sweden  has  an  extensive 
programme  consisting  of  four  main  parts  so  as  to  ensure  a  strong 
school  leadership.  The  four  parts  are: 

1.  Recruitment  programmes.   These  are  administered  by  the  local 
education  authorities  and  are  aiming  at  finding  interested  and 
competent  applicants  for  school  leader  jobs.  These  programmes 
have  been  particularly  important  in  recruiting  women; 

2.  Introductory  programmes.  These  are  also  administered  by  the' 
local  education  authorities  and  are  given  to  newlv  appointed 
school  leader ; 
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3.  Extensive  basic  training  programmes.  These  are  administered  by 
the  NBE  and  are  state  financed; 

4.  Continous  in-service  training  programmes.  These  are 
administered  both  by  local  and  regional  authorities  and  are 
financed  jointly. 

Research  and  development  work  and  results  form  an  important 
part  particularly  in  the  extensive  basic  pre-service  training. 
However,   it  is  recognised  that  school  leaders  are  one  of  the  most 
critical  channels  through  which  R  and  D  could  be  disseminated  and 
used.   It  it,  felt  that,  their  role  as  pedagogical  leaders  must  be 
strengthened.  Too  many  of  them  are  more  engaged  in  administration 
than  in  actual  leadership.  One  other  reason  for  their  difficulty 
to  act  as  a  leader  is  the  fact  that  they  all  are  recruited  from 
the  teacher  corps.  Thus,  a  school  leader  is  regarded  more  as  a 
colleague  than  as  a  head.  This  unclear  role  seems  to  reduce  their 
possibilities  -  and  perhaps  willingness  -  to  take  on  a  strong 
responsibility  for  school  improvement  activities. 

They  should,  however,  be  regarded  to  some  extent  as  a 
specialist  group.  They  should  be  given  the  necessary  support  from 
the  municipal  education  committees,  the  county  education 
committees  and  from  the  NBE.   In  this  way  they  can  become  a  key 
link  between  both  policy  and  research  and  development  work. 

4.  Is  the  use  of  R  and  D  for  school  improvement  a 
specialized  field  with  its  own  staff  and  institutions  (like 
Regional  Laboratories  in  the  U.S.)? 

In  Hungary  and  Sweden  the  answer  is  No.   In  Hungary,   it  is 
the  staffs  of  existing  institutions  which  conduct  the  work  with 
primary  emphasis  on  INSET  and  the  inspectorate.   It  is  the  County 
Institutes  of  Education  which  are  responsible  for  INSET  and  the 
inspectorate.   In  Sweden,   it  is  also  existing  institutions  (see 
Figure  2)  which  are  responsible  for  school  implementation.   It  is 
the  National  Board  of  Education  which  is  alone  responsible  for 
research  follow  up  and  for  the  dissemination  of  central  R  and  D 
information.  Together  with  the  existing  LEAs  and  CECs t   the  NBE  is 
responsible  for  the  implementation  of  local  development  work. 

5.  How  effective  are  the  various  systems  studied  in  using  R  and  D 
for  school  improvement? 

In  the  Hungarian  system,  some  improvements  work  in  some 
schools  and  not  in  others.  Three  examples  may  be  of  interest. 

In  one  development  project  for  small  schools,  audio-tapes 
were  produced  as  materials  for  teachers  and  pupils.  These  were 
very  practical  and  fulfilled  a  need.  They  proved  to  be  very 
popular  with  both.  Th<»  same  is  true  for  a  project  on  item  banking 
where  teachers  could  select  already  tried-out  items  for  use  in 
their  regular  assessments.  Again,   this  was  an  R  and  D  product' 
which  was  of  immediate  practical  use  to  teachers.  Both  products 
were  disseminated  via  in-service  training  and  inspectors. 


2Zb 


-  12  - 


A  third  project  concerned  first  grade  reading.   One  central 
program  had  existed  for  many  years  and  there  was  evidence  that 
reading  comprehension  left  much  to  be  desired.  The  National 
Institute  of  Education  developed  five  alternative  reading 

^ngr^vWithHeViJeuCeuthat'uin  the  lon*  run  but  not  in  the  short 

!y  Produced  higher  achievement.  The  alternative  programs 
were  not,   in  general,  accepted  by  the  schools  because  there  was 
no  visible  immediate  progress  as  there  had  been  under  the 
11**11 *l  °ne  central  program.  The  parents,   too,  complained  about 
the  alternative  programs,   thus  reinforcing  the  teachers' 
opinions. 

AS  a  r«u?r;?leS  ^  ff°m  Sweden'  The  f^st  was  in  mathematics. 

£    0f,a  "agonal  monitoring  exercise  (Marklund,   1987)  it 

vear  t\L  L  ^  I*™1*  °f  thl  National  hierarchy  that  the  13 
comnariS  H*"  Perfor,nin«  P00'1*  "  mathematics  when 

INSET      hi       ?      u  C?untrie8«   There  "as  much  work  undertaken  in 
INSET  and  local  school  development  activities.  These  activities 
had  a  good  effect  in  nearly  all  schools. 

The  second  example  started  at  a  very  local  level  and  was 
inspired  by  the  Bielefeld  Reading  Project.   In  Sweden  it  is  called 

2^«ria^  y  *  ^  a  school  in  southern  Sweden  some  teachers 
and  J"?  learned  about  the  Bielefeld  method,  became  inspired 

and  started  to  work  with  parents  in  their  own  school.  The  Parents 
Association  became  interested  and  they  started  to  develop  mate- 
rial including  a  video  that  was  shown  on  Swedish  TV.   In  this 
case,  local  development  work  spread  like  rings  on  water  and  is 
still  operating.  Here,  there  were  teachers  who  were  willing  to 
test  something  new;  parents,  after  some  hesitation , 'accepted  to 

lint  Sav".and  ^    y  giV!  th6ir  children  that  "quarter  of  an  hour 
f ^  '  8tron«  support  came  from  the  Parents  Association,  and 
TnH^L  5"!  was  attention  from  media,  above  all  Education  TV  (an 
independant  part  of  Swedish  Radio  and  Television).   The  work 

}      °ffi?tal  "notion  as  one  of  the  authors  of  the  study 
material  is  a  civil  servant  at  a  County  Education  Committer. 

Sw«HJrn  in  C°U?t!:ie"  Wlth  Mal1  P°Pul*tion8  Hungary  and 

Sweden),  it  is  at  the  oounty  or  local  education  level  that  the 
contact  is  made  with  each  school  and  it  is  felt  that  oral 
™-ni?atl°n        fhf"  «fM"-root»  level  is  most  effective.   In  all 

Jhe  Cfntrai  level  take8  ^re  to  train,  and  disseminate 
information  to,  the  persons  responsible  for  this  communication  at 

^%fran8;r°0t8  ieVel#  N°thin*  akin  to  the  regional  laboratories 
in  the  U.S.  exists. 

Before  proceeding  to  overall  conclusions  it  is  important  to 
quote  what  Inger  Marklund  handed  in  as  a  summary  of  some  major 
findings  of  a  1980  governmental  committee  on  an  evaluation  of  R 
and  D  in  local  school  development  and  improvement: 

.  research  results  are  more  often  used  at  the  central  educational 
level,   in  policy  making  and  in  curriculum  development  work 

.  thus  research  reaches  teachers  and  schools  more  often 
indirectly  than  directly 
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.  without  a  change-oriented  teacher  corps,  research  results 
very  unlikely  to  reach  teachers  at  all 


.  expectations  of  research  are  often  unrealistic;  teachers  want 
the  answer  to  the  question 

.  a  local  school  development  needs  supporting  agencies,   which  in 
Sweden  are  mainly  the  County  Education  Committees 

.  any  supporting  agency  must  have  a  broad  and  deep  competence  in 
both  development  and  evaluation 

.  research  that  deals  with  a  reasonably  well-defined  area,  where 
teachers  are  asking  for  information  and  knowledge  and  where 
research  provides  new  knowledge  is  more  likely  to  have  an  impact 
educational  practice.  This  has  been  particularly  true  for 
research  on  physically  and  mentally  handicapped  children  in 
school • 


Conclusions 


Some  principles 


There  would  appear  to  be  several  principles  which  should  be 
observed  if  school  improvement  is  to  take  place. 

1.  Mechanisms  for  "up  and  down"  communication 

There  is  most  hope  for  school  improvement  if  a  problem,  or 
set  of  problems,   is  recognized  to  exist  at  all  level's  of  the 
administrative  hierarchy  from  the  school  level  to  the  ministry 
level.  This  provides  a  known  common  ground  on  which  to  build  the 
efforts  of  all  concerned. 


This  common  awareness  involves  two  forms  of  communication. 
The  first  is  a  two  way  communication:  up  and  down  the  hierarchy. 
Teachers  and  school  principals  must  see  that  their  problems  (both 
current  and  foreseen)  are  recognized  at  the  higher  levels  in  the 
administrative  hierarchy.  A  mechanism  must  exist  and  be  seen  to 
exist  for  these  problems  to  be  made  known.  This  must  be 
undertaken  systematically  and  in  such  a  way  that  teachers  can 
formulate  their  ideas. 


In  both  countries  reviewed  in  this  paper,  such  a 
mechanism  clearly  exists.  Problems  for  research  and  suggestions 
for  innovation  and  experimentation  are  deliberately  solicited 
from  schools.  There  is  also  feedback  from  the  higher  levels  to 
the  schools  on  what  action  is  being  undertaken.  The  schools  have 
the  feeling  that  the  higher  levels  care. 

The  second  form  of  communication  is  that  new  ideas  and  new 
research  findings  are  made  known  to  all  levels  of  the  school  * 
system.  Deliberate  steps  can  be  undertaken  to  disseminate  infor- 
mation not  only  through  the  newspapers,   radio  and  television  but 
also  through  the  inspectorate,  through  in-service  training  (and 
through  on-service  training  where  it  exists),   through  special 
newsletters/bulletins  from  the  ministry  to  all  schools  and 
teachers,  and  through  special  journals  for  all  schools. 
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is  also  clear  that  more  information  is  needed  on  the 
effectiveness  of  the  written  word  going  out  to  all  teachers.  How 
many  read  written  communications  of  this  nature  is  not  well 

on°^:  fr?ilfrly'   11  W°uld  be  desi"ble  to  have  more  information 
on  the  effectiveness  of  other  forms  of  communication  e.g.  written 
communication  plus  teacher  meetings  and  so  on.  bitten 

2.  Direct  contact  with  teachers 

th»t  Th?Ki?!?0rtaut  }ink  in  the  Chain  for  sch°o1  improvement  is 

S(rh°o1  PrinciPal  and  the  classroom  teachers. 
Although  dissemination  through  the  written  word  is  popular,  it 
would  appear  that  the  most  effective  dissemination  is  though 
oral  communication.  INSET  and  the  inspectorate  are  the  key 
element  in  dissemination.  Thus,  the  links  between  the 

JnSnri?oat?  (°k  Atf  e?uivalent>  and  the  school  and  between  the 
in-service  teacher  trainers  and  the  teachers  (on  a  regular  and 
compulsory  (?)  basis)  at  the  local  level  are  iruc?J  Presumably, 
level?  in  U*S*  8enSe  WOUld  mean  at  the  district 

3.  Compulsory  in-service  training 

When  in-service  training  is  optional,   it  is  the  'better' 
teachers  who  tend  to  go  to  such  courses.  Hungary  and  Sweden 
arrange  it  that  pupils  have  a  number  of  days  holiday  out  of  the 
school  year  which  the  teachers  do  not  have.  They  attend  in- 
service  courses  where  in-service  training  involves  practical  work 

a     rUl  n.°f  curriculum  materials  and/or  assessment 

materials.  Much  innovation  and  experimentation  is  needed  to 
improve  in-service  education. 

On-sei   xce  teacher  training  is  being  suggested  in  some 
n!?;i£ie8'  Thl\may  be  compulsory  or  voluntary.  Teachers  from 
2  ^n^Vr?ng.8C-°°iS  meet  °n  a  reffular  ba8is  <°nce  a  week  to  once 
th^r  J      E-   Sei^fre?  time  t0  discusa  the  content  and  methods  of 
their  teaching    They  learn  from  each  other.  When  they  have  a 
common  problem  for  which  they  have  no  good  solution,  they  ask  the 
^•TeacJer^T^  ^  hel»' .ln  8oae  ca8ea '  these  teachers'Set 
in  tlVtlll  are"?6"  "  °th-P  in  0ne  °f  the  8choola 

4.  Practical  relevance  of  R  and  D  products 

The  R  and  D  products  must  be  seen  to  be  of  practical 
relevance  to  the  daily  work  of  the  school  and  teacher  (and  to  the 
parents).  The  long  term  and  short  term  effects  must  be  clear. 
Successful  implementation  is  most  often  connected  with  materials 
and  aids  of  direct  and  immediate  use  to  the  teachers.  Of  most 
importance  is  that  the  school  principals  and  teachers  must  see 
the  products  to  serve  their  own  interest.  R  and  D  which  is 
perceived  as  an    academic  game"  for  university  staff  to  win 
points  for  their  own  promotion  or  which  is  written  in  'academese' 
or    technical  jargon'   is  viewed  with  great  suspicion. 
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5.  A  reasonable  teacher  load  and  teacher  interest 

Teachers  must  not  be  overloaded.   Improvements  must  not 
demand  herculean  efforts  by  the  teacher  (is  it  true  that  the 
self-perception  of  a  teacher  is  that  he/she  is  overworked, 
underpaid,  and  under-appreciated?);  nor  should  improvements 
require  a  charismatic  prime-mover.  Too  many  innovations  have 
failed  once  the  prime-mover  has  gone.   If  more  is  demanded  of  the 
teacher  than  the  teacher  thinks  is  worth  while,  then  the  teacher 
will,   in  general,  not  do  it. 

Where  innovation  and  development  has  been  suggested  by  the 
school  and  the  school  is  involved  in  the  development,   it  is 
useful  to  have  reward/encouragement  mechanisms  for  the  teacher 
(e.g.  released  time,  pay  bonus).  The  same  is  true  for  the 
headmaster.   In  other  words,   interest  must  be  encouraged  and  not 
stultified . 

6.  A  central  core  curriculum 

At  mass  education  levels   (i.e.   where  100  percent  of  an  age 
group  is  still  in  school)  in  systems  which  perform  well  there  is 
a  certain  national  core  curriculum.  This  can  range  from  50  to  90 
percent  of  the  total  curriculum.   The  two  countries  used  in  this 
paper  both  have  this.   It  is  also  to  be  noted  that  even  England  - 
bastion  of  decentralisation  in  education  -  has  now  introduced  a 
national  curriculum  to  try  and  ensure  good  minimum  standards  of 
education.   The  notion  of  "let  a  thousand  flowers  bloom"  may 
result  in  100  blooming  very  well  but  what  about  the  weakest  250?! 
Connected  with  the  notion  of  a  core  curriculum  is  the  fact  that 
teachers  and  school  principals  appreciate  information  on  how 
their  classes  or  schools  achieve  compared  with  similar  schools. 
As  systematic  monitoring  occurs,   it  helps  to  have  this  feedback 
mechanism  which,   in  turn,   interests  teachers  in  R  and  D 
activities . 

7.  Good  pre-service  teacher  training 

Where  there  is  a  core  curriculum  and  where  pre-service 
education  ensures  that  the  teachers  know  the  content  of  the 
subject  matter  they  have  to  teach  and  there  is  some  basic 
pedagogical  training,   then  science  and  math  achievement  as 
measured  by  valid  international  tests  is  higher.  Both  countries 
agree  that  their  core  curriculum  and  strict  pre-service  training 
does  help  to  ensure  good  minimum  standards. 

Dotting  the  i's  and  crossing  the  t's 

Principles  are  one  thing.  Procedures  to  ensure  that  the 
principles  are  realized  are  another.  The  procedures  must  fit  to 
the  social  and  school  culture  of  each  system.  At  the  risk  of 
being  presumptuous  it  would  perhaps  be  useful  if  the  U.S.A. 
authorities   (district,   state,  federal)  were  to  answer  the 
following  questions : 

1.  How  are  the  themes  for  R  and  D  and  for  Regional  Laboratories 
decided?  Are  schools  canvassed  about  their  problems  now  and 
problems  they  think  may  arise  in  the  future?  Are  districts 
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canvassed?  Are  state  chief-school-officers  canvassed?  Are 
universities  and  teachers'  colleges  canvassed?  How  regularly? 
Jeeves?        criteria  are  U8ed  deciding  on  priorities?  Who 

2.  When  the  R  and  D  and  Laboratory  budgets  are  divided  up  how 
much  goes  to  schools  for  co-ordinated  inSovatJoT which  the? 
have  suggested  and  how  much  to  the  other  levels  in  the 
administrative  hierarchy  and  how  are  they  involved  in  the 
research,  development  and  implementation  process? 

3.  How  are  ideas  and  information  made  available  to  the  school 
principals  and  teachers?  How  well  is  this  done?  Is  great 
emphasis  placed  on  the  important  link  of  district  level 
KrS"*1  and.thf  ach°°l*?  How  good  are  the  local  inspectors 
(or  their  equivalent)?  Do  they  take  good  ideas  and  proMems 
from  schools  and  pass  these  up  the  hierarchy?  Is  this 
undertaken  in  a  systematic  way?  Do  up  and  down  communication 
mechanisms  exist  and  how  effective  are  they?  ™unicauon 

4.  Are  a  variety  of  forms  of  dissemination  used?  -  The  media 
i!a^frj°UT\l8'  iCa°h"  new8P*Pe™,  SET  materials  as  used  in 
f"!i   -lia  Jew.Ze*land,  inspectors,  in-service/on-servtce 
training!  Which,  in  general,   is  the  most  effective 
combination? 

5.  Are  the  R  and  D  products  practical  or,  at  least,  perceived  to 

tLZlSll    l*,1  to/eachfr«?  Should  regional  labs  (one  per 

theme)  be  abolished  and  smaller  mechanisms  created  all  over 

D  lmhi"Sir^  S'  C??ta?t  with  schools?  Should  the  R  and 

D  labs  be  producing  practical  suggestions  or  products  as  a 
result  of  their  work  and  then  these  can  be  used  at  each  of  the 
many  local  centers  (mechanisms)? 

6*  ™,aI!  national  ">inimum  standards  of  teacher  knowledge 

ensured  as  a  result  of  pre-service  training?  Specifically,  for 
example,  has  every  8th  grade  biology,  chemistrj,  or  physics 

kn^:5g:?apecified  and  required  maatery  °f  thr.uw£t^;t.r 

7.  Is  in-service  training  compulsory  and  does  it  involve  the 
teachers  in  practical  activities? 

8.  What  is  being  done  to  initiate  a  core  curriculum? 


i. i       There  are  no  simple  answers  to  school  improvement.  Both  of 
the  systems  examined  in  this  paper  are  not  fully  happy  w  their 
mechanisms  for  school  improvement  and  they  do  seem  11  be  trying 
solve^hei  Rt     ?1 fc jme'  The  awareness  of  problems  and  the  will  to 
In  aj;.levels  of  an  educational  system  are  paramount 

l2vi7J    I  ?u e\Thls  awareness  entails  interconnection  at  all  ' 
llltJ*  hierarchy.  The  final  link  in  the  hierarchy  with  the 

schools  is  crucial.  If  the  teachers  are  not  listened  to, 
communicated  with,  and  encouraged  in  a  systematic  and  regular 
s^esi^V^  bVxPected'  ^ove  all,  teachers  mllst  perceive 
suggested  changes  to  be  in  their  own  self-interest. 
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This  paper  discusses  several  programs  of  technical  assistance  funded  by 
the  U.S.  Department  of  Education  (ED).     Its  original  purpose  was  to  draw 
lessons  from  these  programs  that  might  illuminate  issues  in  the  provision  of 
"indirect  service,"  which  is  a  strategy  dev'sed  for  regional  laboratories. 
The  last  request  for  proposals  (RFP)  for  laboratories  defined  this  strategy 
of  promoting  educational  improvement  by  working  "with  and  through"  other 
agencies  and  organizations  engaged  in  work  related  to  improvement.  The 
laboratories  are  expected  to  forge  relationships  with  these  potential 
partners  and  make  a  contribution  to  their  work.    The  original  rationale 
this  strategy  was  that  the  limited  resources  available  for  laboratories 
could  hardly  support  a  very  broad- -but  desirible- -mission  of  improving 
education  in  the  many  states,  school  districts,  and  schools  within  a  region. 
Rather  than  make  difficult  and  inevitably  unfair  choices  among  the  many 
clients  that  could  potentially  benefit  from  their  direct  nalp,  the 
laboratories  are  supposed  to  achieve  efficiencies  by  providing  much  of  th,  i- 
help  indirectly. 

As  the  reader  will  see,  lessons  about  indirect  service  are  few  and  far 
between  in  these  other  assistance  programs.     Instead,  my  analysis  shows  that 
the  basic  purposes,  clientele,  and  philosophy  of  ED's  other  large  assistance 
programs  are  quite  different  from  those  of  laboratories.     Identifying  the 
differences  helps  to  underscore  the  difficulty  of  the  charge  to 
laboratories.     The  idea  of  providing  indirect  service  is  itself  a  challenge 
to  the  laboratories --one  without  a  counterpart  in  the  other  large  programs 
reviewed  here. 
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ED- Funded  Assistance  Programs 

The  five  ED  programs  described  in  this  paper  provide  services  that  aie 
like  those  of  laboratories  in  some  ways  and  unlike  them  in  o.hers.    As  a 
basis  for  analyzing  these  similarities  and  differences,  particularly  vith 
respect  to  indirect  service,  this  section  describes  the  basic  features  of 
each  assistance  program.    Included  are  the  program's  funding  level,  purpose, 
activities,  clientele,  and  requirements  for  coordination  with  other  service 
providers  and  for  evaluation.    The  principal  source  of  information  on  the 
design  of  each  program  is  its  most  recent  RFP  or  program  regulations,  in 
which  the  federal  sponsor  outlines  the  expectations  for  contractors.  In 
some  cases,  the  current  program  design  reflects  changes  over  time.  These 
are  also  described,  along  with  any  evidence  from  prior  program  evaluations 
concerning  the  program's  past  performance.     (Such  evidence  is  very  sparse 
for  these  programs,  however.) 

Multifunctional  Resource  Centers 

A  total  of  $10  million  supports  the  16  Multifunctional  Resource  Centers 
(MRCs),  which  provide  assistance  to  their  regions  in  the  education  of 
children  with  limited  English  proficiency  (LEP) .    They  give  priority  to 
assisting  projects  funded  under  the  federal  Title  VII  program,  which 
supports  both  bilingual  programs  and  alternate  instructional  approaches  for 
LEP  students.     In  addition,  MRCs  may  help  projects  that  do  not  have  federal 
funding  but  that  are  specifically  designed  for  LEP  students. 

The  word  -multifunctional"  identifies  the  responsibilities  of  these 
centers  as  more  wide-ranging  than  those  of  their  predecessors,  reflecting  a 
reorganization  of  technical  assistance  in  bilingual  education  that  took 
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place  in  1983.    Before  that  time,  ED  funded  three  types  of  assistance 
providers:    Bilingual  Education  Service  Centers;  Evaluation,  Dissemination, 
and  Assessment  Centers;  and  Materials  Development  Projects.  In 
congressional  testimony  and  in  the  first  RFP  for  multifunctional  centers, 
the  Office  of  Bilingual  Education  and  Minority  Languages  Affairs  expressed 
the  view  that  this  array  of  service  providers  had  several  disadvantages: 
school  districts  and  states  had  zoo  many  different  organizations  to  turn  to; 
duplication  of  services  occasionally  took  place;  and  local  needs  were  not 
always  clear  to  the  assistance  providers  (Kutner  &  Pelavin,  1987).     The  new 
centers,  then,  were  expected  to  provide  a  more  coherent  focus  on  local 
needs . 

The  RFP  identifies  the  multifunctional  centers'  primary  clients  as 
individuals  "participating  or  preparing  to  participate  in"  classroom 
instructional  projects  in  bilingual  education.    Accordingly,  the  centers 
emphasize  training.    The  RFP  requires  each  center  to  expend  at  least  50 
percent  of  its  total  effort  "in  providing  technical  assistance  and  training 
to  projects  and  LEAs  to  implement  program  improvement  activities  and/or  to 
upgrade  teacher  performance  in  specific  content  or  subject  areas."  The 
instructions  in  the  RFP  focus  the  MRCs  on  directly  serving  school  districts 
and  the  individuals  within  them- -answering  questions,  providing  aid  and 
guidance,  and  presenting  workshops  relevant  to  teacher  performance.  They 
also  direct  the  centers'  mission  towan   program  improvement  and  the 
upgrading  of  local  performance. 

While  the  MRCs  are  expected  to  assist  aM  train  teachers  at  the  local 
level,  they  have  formal  relationships  with  contact  people  at  the  state 
level.     For  each  state  in  which  an  MRC  works,  it  negotiates  a  written  letter 


of  agreement  with  a  state  contact  person,  spelling  out  specific 
collaborative  activities  between  the  MRC  and  the  SEA  and  specifying  the 
procedures  the  MRC  will  follow  in  contacting  school  districts.  Negotiations 
with  the  SEA  are  intended  to  ensure  that  the  MRC's  services  do  not  duplicate 
or  supplant  services  that  the  state  provides.    Early  in  each  contract  year, 
a  Regional  Coordinating  Meeting  brings  together  the  state  Tit'e  VII 
coordinators,  state  contact  people,  MRC  project  directors,  and  the  federal 
project  officer  for  a  discussion  of  area  concerns  and  plans. 

The  RFP  also  gives  the  MRCs  instructions  about  coordinating  their  work 
with  other  assistance  providers  —  primarily  the  other  organizations  that 
Title  VII  also  funds  to  provide  assistance.    The  MRCs'  written  plan  for 
service  delivery  must  contain  plans  for  coordination  with  their  fellow  MRCs, 
the  Evaluation  Assistance  Centers  (EACs),  and  the  National  Clearinghouse  for 
Lilingual  Education  (NCBE) .    They  refer  clients  to  the  EACs  or  NCBE  when 
those  organizations  can  meet  l^c^l  needs.    Their  relationship  with  the  EACs 
is  addressed  in  some  detail  in  the  RFP,  which  tells  them  they  may  follow  up 
EAC  assistance,  refer  state  and  local  clients  to  the  EACs  and  obtain 
referrals  from  the  EACs,  collaborate  on  dissemination,  and  cosponsor 
inservice  training.    It  prohibits  them  from  providing  the  assistance  with 
evaluation  that  the  EACs  are  authorized  to  provide,  unless  they  first 
coordinate  with  the  EAC  and  obtain  federal  government  approval. 

Evaluation  is  decentralized  In  this  program.    In  an  annual  performance 
report,  each  MRC  is  to  summarize  its  activities  and  accomplishments,  with 
attention  to  users'  responses  and  other  major  outcomes.    It  must  also 
develop  ways  to  integrate  evaluation  remits  into  its  future  operations. 
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Dni£-Free  Schools  and  Communities  Act:     Regional  inters 

The  five  regional  drug  education  and  prevention  centers  receive  annual 
funding  of  $8.8  million  under  the  Drug-Free  Schools  and  Communities  Act. 
Most  funds  under  this  act  go  to  states  for  local  projects  to  be  conducted  by 
school  districts  and  other  organizations,  but  4.5  percent  of  the  total  funds 
are  earmarked  for  the  regional  centers. 

Regional  centers  for  the  prevention  of  drug  abuse  have  existed  since 
1972,  but  the  most  recent  competition  for  funding  broadened  their  mission 
beyond  their  traditional  one  of  training  "school  teams."    In  the  past,  the 
great  bulk  of  center  activities  consisted  of  residential  workshops  in  which 
^  team  from  each  participating  school  learned  to  work  together  to  develop 
its  own  approach  to  the  prevention  of  drug  and  alcohol  abuse.     The  new  RFP 
continues  to  include  the  training  of  school  teams  as  a  focus  but  adds  other 
activities  designed  to  assist  SEAs,  school  districts,  and  institutions  of 
higher  education,  as  well  as  evaluation  and  dissemination  of  information. 

For  SEAs,  the  centers  must  provide  training  and  assistance  related  to 
assessing  problems  with  substance  abuse,  developing  and  enforcing  school 

olicies,  helping  districts  and  schools  with  their  own  programs,  and 
improving  coordination  among  substance  abuse  programs. 

At  the  local  level,  the  centers  are  to  develop  relationships  between 
school  districts  and  institutions  of  higher  education,  focusing  on  the 
training  of  education  personnel.    They  are  also  to  assist  in  locally  based 
preservice  and  inservice  training  programs  in  the  prevention  of  drug  and 
alcohol  abuse. 

Centers  are  also  instructed  to  develop  methods  for  evaluating  the 
effectiveness  of  prevention  programs.    They  are  to  evaluate  their  own 
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services,  mnd  (4)  the  effects  on  efforts  to  eliminate  and  prevent  substance 
abuse . 

Desegregation  Assistance  Centers 

With  $8.2  million  in  annual  funding,  the  10  regional  Desegregation 
Assistance  Centers  (DACs)  assist  local  school  boards  with  the  preparation, 
adoption,  and  implementation  of  desegregation  plans  and  the  development  of 
solutions  to  desegregation-related  problems  in  education.    The  DACs  exist  by 
authority  of  the  Civil  Rights  Act  of  1964.    In  the  past,  ED  funded  specific 
centers  to  deal  with  desegregation  issues  related  to  race,  national  origin, 
and  sex.    The  current  DACs  combine  all  these  areas  of  focus,  with  the  result 
that  the  10  DACs  carry  out  work  that  40  more  specialized  DACs  did  before 
1987. 

Upon  request  from  a  school  board,  a  DAC  may  provide  information, 
advice,  assistance,  and  training  for  school  staff,  students,  parents,  and 
community  members.    The  DACs  are  prohibited  from  providing  assistance 
without  a  request  from  a  school  board  or  other  responsible  government 
agency . 

The  Civil  Rights  Act  also  authorizes  SEAs  to  provide  help  with 
desegregation- related  problems,  and  many  SEAs  are  funded  to  carry  out 
activities  like  those  of  DACs.    The  DACs  are  to  coordinate  their  assistance 
with  that  of  the  SEAs.     In  cases  where  a  government  agency  asks  both  the  DAC 
and  the  SEA  for  help,  the  DAC  must  develop  plans  to  prevent  duplication  of 
assistance.    The  program  regulations  also  suggest  that  collaboration  with 
other  agencies  may  be  a  useful  part  of  this  program,  since  applicants 
receive  points  for  "past  successes  in  . . .  collaborating  with  other 
individuals  and  organizations." 
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DACs  are  expected  to  have  evaluation  plans  that  "to  the  extent 
possible,  are  objective  and  produce  data  that  are  quantifiable."  Findings 
from  these  evaluations  have  not  been  compiled  across  centers  in  many  years, 
and  the  program  has  had  no  external  evaluation  since  1976.     (A  contractor 
produced  a  "descriptive  overview"  in  1985  but  drew  no  conclusions  about  the 
effects  of  DAC  activities.) 

Regional  Resource  <>nm? 

Six  Regional  Resource  Centers  (RRCs)  receive  a  total  of  $6.7  million  to 
assist  states  in  carrying  out  the  Education  of  the  Handicapped  Act.  Since 
1977,  the  RRCs'  chief  purpose  has  been  to  assist  in  program  development  and 
implementation;  before  that  time,  the  centers  had  the  very  different  purpose 
of  testing  and  serving  individual  handicapped  children.    As  national  needs 
and  priorities  in  special  education  have  changed,  the  Office  of  Special 
Education  Programs  (OSEP)  has  given  the  RRCs  specific  instructions  for  their 
program  focus,  often  in  response  to  new  legislative  provisions. 

In  their  current  work  with  SEAs,  the  RRCs  must  be  able  to  address  two 
widespread  problems  identified  by  OSEP:    SEA  monitoring,  and  implementation 
of  the  requirement  to  serve  handicapped  children  in  the  least  restrictive 
environment  (LRE) .     In  addition,  OSEP  has  told  the  RRCs  to  help  their 
clients  with  issues  in  three  areas:     (1)  the  transition  from  school  to  work 
and  adult  life,   (2)  parent  involvement  in  educational  decisionmaking,  and 
(3)  infant,  toddler,  and  early  childhood  services. 

The  activities  of  RRCs  include  consulting  with  SEAs  in  defining 
problems  and  solving  them,  conducting  workshops  and  conferences  that  link 
SEAs  with  other  professionals  and  parents,  and  synthesizing  and 
disseminating  information.    They  also  help  in  developing,  identifying,  and 

8 


ERLC 


24[) 


replicating  successful  local  programs  and  practices.    If  an  SEA  asks  an  RRC 
for  help  with  the  procedures  and  format  for  a  grant  proposal,  the  RRC  may 
provide  such  help. 

The  RRCs  work  predominantly  with  SEAs.    They  meet  with  the  SEAs  in 
their  region  to  develop  a  joint  planning  report,  which  provides  a  detailed 
summary  and  ranking  of  each  SEA's  technical  assistance  needs,  and  an 
assistance  agreement  for  each  SEA  consistent  with  its  priority  needs.  The 
processes  of  needs  assessment  and  planning  are  not  entirely  directed  by  the 
states,  however.    OSEP  representatives  participate  in  the  joint  planning 
meetings,  and  they  assist  in  determining  state  needs  and  priorities. 

A  seventh  contractor  called  the  Federal  Regional  Resource  Center  (FRRC) 
has  recently  been  established  to  assist  the  RRCs.     Its  purposes  are  to 
ensure  consistency  in  the  content  and  strategies  of  technical  assistance 
across  regions  and  to  ensure  coordination  of  services  among  the  RRCs  and 
with  other  federally  funded  projects. 

OSEP  prescribes  procedures  for  evaluation  and  reporting  that  are 
designed  to  track  not  only  activities  but  also  client-level  outcomes.  The 
'.<Cs  submit  quarterly  reports  on  the  assistance  they  have  given  to  states. 
They  must  also  design  and  carry  out  a  system  of  impact  assessment,  under 
which  they  are  to  identify  changes  in  educational  services  or  administration 
that  result  from  each  of  their  technical  assistance  activities. 

Technical  Assistance  Centers 

Under  Chapter  1,  the  federal  compensatory-education  program,  six 
Technical  Assistance  Centers  (TACs)  receive  $3.6  million  to  assist  SEAs  and 
school  districts  with  Chapter  1  evaluation  and  program  improvement.  The 
TACs  were  originally  set  up  under  the  Education  Amendments  of  1974,  which 
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prescribed  a  new,  elaborate  evaluation  antf  reporting  system  for  compensatory 
education  and  which  offered  TAC  assistance  to  ease  the  work  of  carrying  out 
these  evaluation  requirements.    Over  the  years,  their  emphasis  has  shifted 
away  from  the  technical  aspects  of  evaluation  (although  that  remains  one 
part  of  their  assistance  repertoire)  and  toward  program  improvement- - on 
which  the  government  now  requires  them  to  spend  half  of  their  effort. 

The  TACs  provide  most  of  their  assistance  in  the  form  of  workshops, 
responses  to  telephone  inquiries,  and  some  onsite  assistance.  In 
evaluation,  they  help  SEAs  and  school  districts  on  such  topics  as  testing 
procedures,  development  of  microcomputer  databases,  and  coordination  of 
Chapter  1  testing  with  the  testing  that  the  districts  or  states  administer 
to  all  students.    Their  workshops  and  other  assistance  on  program 
improvement  emphasize  the  use  of  local  eva^aation  results  and  effective- 
schools  principles  to  inform  improvement  efforts;  for  example,  closer 
coordination  between  Chapter  1  services  and  the  regular  school  program  is 
often  a  topic  of  assistance. 

The  TACs  work  with  SEAs  in  planning  and  delivering  their  assistance. 
They  negotiate  a  letter  of  agreement  with  each  SEA  in  the  region,  which 
specifies  what  the  TAC  will  do  at  the  state  and  local  levels  and  how  it  will 
contact  school  districts.     (Some  SEAs  take  the  lead  in  contacts  between  the 
TAC  and  the  districts,  while  others  simply  ask  to  be  kept  informed  about 
what  the  TAC  is  doing  with  districts.)    TAC  staff  members  often  make 
presentations  to  groups  of  local  educators  at  workshops  that  the  SEAs 
organize.    The  TACs  primary  contact  person  at  the  SEA  is  typically  someone 
in  the  state  Chapter  1  office,  although  in  some  states  TACs  also  work 
closely  with  state  evaluation  personnel. 
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The  RFP  for  TACs  requires  coordination  of  efforts  across  TACs  and  with 
other  assistance  providers  in  the  region.    However,  because  the  TACs' 
mission  is  so  focused  on  Chapter  1  issues,  the  work  of  other  assistance 
providers  is  seldom  closely  related  to  it. 

The  TACs  are  required  to  report  on  their  activities  but  not  to  evaluate 
them.    They  keep  a  record  of  topics  on  which  they  provide  assistance  and  of 
"client  hours"  of  contact  (a  figured  derived  by  multiplying  the  number  of 
clients  attending  an  event,  such  as  a  workshop  or  onsite  assistance  session, 
by  the  length  of  the  event) .     They  submit  narrative  reports  on  a  quarterly 
and  annual  basis. 

Indirect  Service  in  These  Programs 

By  and  large,  the  programs  described  here  are  geared  to  the  provision 
of  direct  service.    They  offer  workshops,  consultation,  training,  and 
answers  to  questions- -mostly  delivered  directly  to  administrators  and 
teachers  in  instructional  programs.    None  of  them  has  a  charge  resembling 
the  laboratories'  charge  to  work  "with  and  through"  other  organizations  in 
the  indirect  pursuit  of  improvement. 

Nevertheless,  It  is  possible  to  identify  a  few  respects  in  which  these 
other  assistance  providers  might  be  said  to  provide  indirect  service. 

Presence  of  "Gatekeepers" 

With  the  exception  of  the  centers  funded  under  the  Drug-Free  Schools 
and  Communities  Act,  these  assistance  providers  are  told  by  their  federal 
sponsors  to  negotiate  their  assistance  plans  with  contact  people  in  specific 
agencies.    The  DACs  are  told  that  they  must  await  requests  from  school 
boards  or  other  responsible  government  entities.    For  the  bilingual  MRCs, 
the  RRCs  for  the  handicapped,  and  the  Chapter  1  TACs,  the  designated  contact 
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people  are  in  SEAs- -almost  always  in  a  federally  funded  program  office.  In 
all  these  cases,  any  services  provided  to  local  educators  must  be  cleared  in 
some  way  with  the  gatekeepers  that  the  federal  government  has  identified. 
The  idea  is  to  maintain  identifiable  points  of  control  over  the  services 
offered  and  thus  to  ensure  a  degree  of  responsiveness  to  a  set  of  primary 
clients . 

The  three  assistance  programs  for  which  the  SEA  is  a  gatekeeper  vary  in 
the  extent  to  which  their  services  could  be  called  indirect.    The  RRCs  for 
special  education  are  the  farthest  from  the  indirect  model.    They  exist 
primarily  to  provide  direct  support  to  the  SEAs  themselves,  responding  to 
ED's  priorities  as  well  as  those  of  the  SEA,  and  only  to  a  limited  extent  do 
they  work  through  SEAs  to  offer  assistance  at  the  local  level.     For  both  the 
bilingual  MRCs  and  the  Chapter  1  TACs,  the  negotiation  of  state- level  plans 
is  partly  a  matter  of  protocol- -a  way  of  allowing  the  SEA  to  suggest 
priorities  for  local  service  and  to  specify  the  procedures  for  making 
contact  with  local  school  districts.    The  states  vary  in  the  amount  of 
direction  they  give  to  these  assistance  providers.    In  addition,  both  of 
these  assistance  programs  do  one  thing  with  SEAs  that  could  correspond  to  a 
notion  of  indirect  service:    they  present  workshops  at  SEA-sponsored 
conferences . 

Because  they  are  told  to  work  with  contact  people  in  SEAs,  and  because 
these  contact  people  typically  receive  federal  funding  to  administer  a 
particular  federal  program,  these  three  assistance  programs  are  integral 
parts  of  a  vertical  network  running  from  ED  through  the  SEAs  to  school 
districts.    The  Chapter  1  TACs  illustrate  this  vertical  arrangement.  They 
work  closely  with  the  SEA  Chapter  1  directors,  and  their  local  contact 
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people  are  typically  Chapter  1  directors  as  well.    While  their  workshops  may 
address  the  coordination  of  Chapter  1  and  regular  services,  non-Chapter  1 
personnel  like  principals  and  classroom  teachers  are  not  really  their 
clients.    Adherence  to  the  program's  legal  and  regulatory  requirements  is  a 
theme  running  through  TAC  assistance.     Indeed,  although  the  TACs  are 
sponsored  by  ED's  Office  of  Planning,  Budget  and  Evaluation,  one  of  the 
services  they  perform  for  SEAs  and  districts  is  to  convey  and  interpret 
messages  from  ED's  Office  of  Compensatory  Education.    Similarly,  both  the 
bilingual  MRCs  *nd  the  handicapped  RRCs  do  their  planning  in  meetings  that 
bring  together  officials  from  SEAs  and  from  ED's  program  office. 

In  short,  then,  the  assistance  providers'  relationship  with  state -level 
gatekeepers  tends  to  reinforce  their  focus  on  issues  that  are  central  to  a 
particular  federal  program  (as  implemented  in  each  state).    As  I  will 
discuss  below,  one  result  is  a  convergence  of  mission  within  each  program 
that  contrasts  with  the  divergence  that  the  laboratories  experience  in  their 
service  requests  from  clients. 

Coordination  with  Other  Assistance 

ED  requires  all  these  assistance  providers  to  coordinate  their  work 
with  that  of  others.    This  requirement  does  not  generally  involve  working 
"with  and  through"  others,  however.     Instead,  the  dominant  idea  is  to 
prevent  duplication  of  effort.    A  typical  federal  mandate  is  the  one  given 
to  the  desegregation  assistance  centers,  which  are  told  Co  make  sure  they  do 
not  duplicate  services  that  the  SEA  provides  to  any  particular  school 
district. 

Probably  the  closest  resemblance  to  indirect  service  is  found  in  the 
instructions  to  the  bilingual  MRCs.    Unlike  the  other  assistance  programs, 
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which  have  quite  global  requirements  for  service  coordination,  the  MRCs  are 
told  explicitly  that  they  should  refer  clients  to  the  Evaluation  Assistance 
Centers  and  the  National  Clearinghouse  for  Bilingual  Education  when  either 
of  those  contractors  could  fill  a  client's  needs.     (This  may  reflect  the 
fact  that  the  MRCs'  sponsors  have  given  considerable  thought  over  the  years 
to  the  interrelationships  among  the  various  assistance  providers  they 
support. ) 

One  activity  for  the  regional  centers  for  the  prevention  of  substance 
abuse  does  involve  promoting  ties  between  local  school  districts  and  other 
service  providers.    These  centers  are  told  to  work  with  districts  and  with 
institutions  of  higher  education  to  strengthen  the  ties  between  them  and 
thus  promote  continuing  preservice  and  inservice  training  for  local 
educators . 

For  the  most  part,  though,  the  federal  RFPs  address  the  matter  of 
coordination  by  telling  contractors  how  to  ensure  that  their  assistance  does 
not  duplicate  anything  else  that  is  offered—especially  anything  else  that 
is  federally  funded.    These  requirements  appear  to  stem  from  concerns  about 
waste  and  about  possible  turf  disputes.     For  example,  botli  the  bilingual 
MRCs  and  the  desegregation  DACs  are  told  to  make  sure  that  their  services  do 
not  duplicate  those  of  SEAs.    The  MRCs  are  also  prohibited  from  doing  what 
the  EACs  are  authorized  to  do,  unless  the  project  officer  gives  them  prior 
approval. 

Not  surprisingly,  coordination  is  not  an  active  focus  for  the  work  of 
these  assistance  providers.     Studies  of  the  predecessors  of  the  current  MRCs 
and  TACs  have  shown  few  or  no  activities  that  could  be  characterized  as 
coordination  (Kutner  &  Pelavin,  1987;  Reisner  et  al.,  1988).    The  data  on 
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the  TACa,  which  I  helped  to  analyze,  showed  that  most  TACs  viewed  other 
assistance  providers  in  their  regions  as  their  likely  competitors  for  future 
contracts,  and  that  therefore  they  avoided  sharing  much  information  with 
these  organizations.    Moreover,  the  federal  concern  about  duplication  of 
effort  appeared  overblown,  at  least  for  the  TAC  program.    Cc  apared  to  the 
magnitude  of  needs  in.  •  uool  districts,  federal  snd  state  resources 
available  for  technic  al  assistance  are  much  too  small  to  create  a  danger  of 
redundancy. 

Training  of  Trailers 

In  general,  these  assistance  providers  offer  training  for  x^cal 
educators.     (The  exception  I,-  the  RRCs,  which  basically  provide  training  and 
support  to  SEAs.)    To  some  extent,  the  organizations  that  serve  local  staff 
may  choose  to  increase  their  own  efficiency  by  training  people  who  are  in  a 
position  to  train  others.    This  is  not  a  federally  mandated  strategy, 
however.     There  is  no  evidence  on  the  extent  to  which  i'   takes  place. 

Identification  and  Dissemination  of  i'udel  Practices 

The  development,  identification,  or  dissemination  of  model  practices  is 
not  indirect  service.     In  a  sense,  it  represents  an  alternative  to  indirect 
service,  since  it  is  another  strategy  by  which  an  assistance  system  with 
limited  resources  C£n  achieve  efficiency.    Its  popularity  in  the  assistance 
systems  discussed  here  appears  to  be  growing. 

For  example,  the  regional  centers  for  the  prevention  of  substance  abuse 
previously  took  the  approach  of  working  intensively  with  teams  from 
participating  schools .    The  emphasis  was  on  effective  ways  of  identifying 
problems  with  drug  and  alcohol  abuse  in  a  school,  bringing  community 
resources  to  bear,  and  designing  and  carrying  out  solutions  tailored  to  the 
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problems.    Data  from  clients  indicated  great  satisfaction  with  this  approach 
but  also  an  interest  in  knowing  more  about  proven  models  for  the  prevention 
of  substance  abuse  (Kutner  et  al. ,  1987).    At  the  same  time,  a  more  general 
analysis  of  federal  efforts  to  prevent  drug  abuse  indicated  a  lack  of 
knowledge  about  what  strategies  work  (GAO,  1987).     The  result  has  been  a  new 
emphasis  in  the  latest  RFP  on  the  identification  and  dissemination  of 
effective  models.    The  centers  are  also  supposed  to  assist  their  clients  in 
evaluation,  thus  adding  some  rigor  to  the  determination  of  the  models' 
effectiveness . 

In  the  early  1980s,  the  TACs  often  worked  with  districts  that  were 
seeking  recognition  under  a  special  federal  initiative  that  identified 
effective  Chapter  1  programs.     Although  this  effort  has  become  more 
routinized  and  now  demands  less  attention  from  the  TACs,  the  model  practices 
identified  through  this  initiative  remain  part  of  the  TACs'  repertoire. 
They  often  serve  to  illustrate  the  principles  that  the  TAC  staff  emphasize 
in  their  workshops  and  consultation  on  the  subject  of  program  improvement. 
Data  from  clients  show  that  state  and  local  Chapter  1  directors  are  very 
interested  in  knowing  more  about  effective  models  (Reisner  et  al.,  1988). 

The  identification  and  dissemination  of  model  practices  is  also  part  of 
the  mandate  for  bilingual  MRCs  and  handicapped  RRCs.  Methods  of  identifying 
models  and  criteria  for  determining  their  effectiveness  are  not  specified. 

Conclusions 

This  review  indicates  that  indirect  service  as  practiced  by  the 
laboratories  appears  to  be  a  unique  phenomenon  in  ED's  technical  assistance 
activities.    The  other  assistance  programs  typically  touch  base  with  some 
other  assistance-oriented  agency,  most  often  an  SEA;  they  are  told  to 
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coordinate  their  work  with  that  of  others  (chiefly  to  avoid  duplication  of 
services);  and  they  may  achieve  efficiencies  by  training  trainers  or 
identifying  and  disseminating  models.     In  all  these  respects,  the  intended 
outcome  is  to  make  the  most  of  limited  resources  by  avoiding  confusion  or 
wasted  effort.    However,  in  none  of  these  programs  is  there  a  central  focus 
on  cultivating  relationships  with  an  array  of  organizations  as  an 
alternative  to  working  directly  with  educators.    I  turn  now  to  an  analysis 
of  this  and  other  contrasts  between  the  laboratories  and  ED's  other 
assistance  programs. 

Peculiarities  of  the  Laboratory  Program 

I  come  away  from  this  research  on  technical  assistance  systems  with  a 
new  appreciation  for  the  unusual  challenges  that  laboratories  face  in 
carrying  out  their  ambitious  assignment.    The  contrasts  between  laboratories 
and  ED's  programmatic  systems  of  technical  assistance  provide  a  way  of 
illustrating  these  challenges. 

The  Laboratories'  Mission  Is  Diffuse 

While  it  is  obvious  to  say  that  school  inprovement  is  a  broad  and 
amorphous  mission,  the  contrast  between  that  mission  and  those  of  ED's  other 
technical  assistance  providers  is  dramatic.    Three  of  the  five  large 
programs  reviewed  here- -the  bilingual  MRCs,  the  handicapped  RRCs,  and  the 
Chapter  1  TACs--derive  their  focus  from  federal  categorical  programs.  They 
are  supposed  to  promote  improvement  in  the  services  underwritten  by  a 
specific  funding  source.     (The  MRCs  may  also  assist  LE?  programs  that  do  not 
receive  federal  funding,  but  their  purposes  must  be  consistent  with  those  of 
Title  VII.) 
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The  two  remaining  programs  have  missions  focused  around  particular 
societal  problems.    Substance  abuse  and  school  segregation  are  officially 
recognized  evils  for  which  the  federal  government  provides  remedies,  and 
technical  assistance  is  one  remedy.    When  school  districts  and  schools  have 
difficulty  in  preventing  substance  abuse  or  solving  the  problems  that  arise 
in  desegregation,  they  may  call  on  these  assistance  programs  for  technical 
expertise. 

The  TACs'  history  provides  a  further  illustration  of  the  specificity 
inherent  in  most  technical  assistance  systems'  missions.  Originally 
established  to  help  SEAs  and  districts  carry  out  a  particular  system  of 
evaluation  and  reporting,  the  TACs  have  only  gradually  carved  out  a  mission 
that  extends  as  far  as  the  quality  of  the  Chapter  1  program.    As  a  result, 
the  use  of  evaluation  findings  as  a  starting  point  for  program  improvement 
is  an  anchoring  theme  for  much  of  the  TACs'  work.    Thus,  these  contractors' 
mission  is  limited  not  just  to  Chapter  1  improvement  but,  by  history  and 
custom,  to  a  particular  philosophy  of  improvement.    The  tangibility  of 
mission  that  this  offers  to  assistance  providers  and  clients  alike  is 
important. 

With  a  broad  mission,  deciding  what  to  do  and  what  not  to  do  is  a 
continuing  di]  3  nun  a .    The  assistance  providers  whose  missions  are  more 
circumscribed  than  that  of  the  laboratories  do  face  choices,  but  the 
priorities  of  the  federal  program  office  or  of  clearly  identified  clients 
help  them  in  making  these  choices.    In  particular,  clarity  about  who  their 
clients  are  is  helpful,  and  that  is  the  next  point  of  contrast  with 
laboratories. 
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The  Laboratories '  Clients  and  Partners  Are  Diverse 

For  a  programmatic  system  of  technical  assistance,  the  primary  clients 
and  primary  working  partners  are  clearly  identified.    An  MRC  director  needs 
good  working  relationships  with  state  Title  VII  directors;  an  RRC  director 
with  state  directors  of  special  education;  and  a  TAC  director  with  state 
Chapter  1  directors.    The  state  contact  person  may  be  a  difficult  partner, 
and  the  assistance  provider  may  have  to  negotiate  around  tensions  between 
the  SEA  and  the  federal  program  office,  but  at  least  the  cast  of  characters 
is  well  specified.     For  all  these  systems,  too,  relationships  with  local 
districts  are  coordinated  through  the  state  contact  person.     Services  may 
have  to  be  rationed,  but  the  SEA  participates  in  making  the  difficult 
choices  about  providing  or  denying  service. 

The  federal  sponsors  of  the  problem- focused  assistance  programs  (those 
concerned  with  substance  abuse  and  desegregation)  have  recognized  that  these 
programs  may  face  issues  of  rationing  services.    The  centers  for  substance 
abuse  prevention  are  told  to  organize  advisory  boards ,  representing  specific 
parties  within  the  region,  to  help  them  select  clients.     Because  the  DACs 
are  prohibited  from  soliciting  clients,  selection  is  less  likely  to  be  a 
problem  for  them.    However,  they  are  still  told  to  coordinate  services  with 
the  SEAs  in  order  to  avoid  duplication. 

In  the  rare  cases  where  another  assistance  system  might  be  said  to  work 
"with  and  through"  a  partner,  its  natural  partners  are  generally  easy  to 
identify.    Having  a  contact  person  in  the  SEA  program  office  means,  for 
example,  that  the  SEA  is  the  primary  organizer  of  conferences  at  which  the 
MRC  or  RRC  or  TAC  puts  on  workshops.    For  the  MRC*,  which  exist  alongside 
other  federally  funded  organizations  providing  help  in  the  education  of  LEP 
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students,  ways  of  cooperating  with  each  of  these  organizations  are  spelled 
out  in  the  RFP. 

The  Laboratories  Are  Asked  to  Demonstrate  Effectiveness 

Evaluation  has  not  been  completely  absent  from  these  other  technical 
assistance  programs,  and  for  some  of  them  it  is  becoming  an  increasing  focus 
of  effort.    In  general,  though,  their  histories  have  boen  characterized  by  a 
somewhat  casual  approach  to  evaluation  in  contrast  to  that  which  has 
surrounded  the  laboratories. 

Examples  of  serious  evaluation  requirements  are  now  found  in  the 
handicapped  RRCs  and  the  centers  for  prevention  of  substance  abuse.  The 
RRCs  must  not  only  report  on  their  work  and  accomplishments  but  must  also 
show  links  between  their  technical  assistance  activities  and  changes  in 
educational  services  or  administration.    The  substance  abuse  centers  must 
evaluate  their  own  work  with  "precision  and  objectivity"  and  also  be 
prepared  for  an  external  evaluation  of  their  effectiveness. 

For  the  most  part,  although  the  technical  assistance  programs  are 
required  to  tell  their  sponsors  what  they  are  doing  and  what  they  have 
accomplished,  their  accountability  for  the  ultimate  effects  of  their  work  is 
somewhat  limited.    With  the  exception  of  the  RRCs,  they  are  not  asked  to 
track  the  effects  of  their  work  to  the  level  of  educational  service 
delivery. 

Across  the  board,  the  assistance  programs  seem  to  lack  evaluation 
techniques  that  would  yield  good  evidence  on  their  effectiveness.  The 
laboratories,  with  their  base  in  research  and  development,  might  be  in  a 
gooc*  position  to  contribute  to  the  state  of  the  art  in  evaluating  technical 
assistance.    A  first  step  would  be  for  the  federal  sponsors  of  technical 
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assistance  to  acknowledge  that  better  evaluation  methods  reed  to  be 
developed. 

Concluding  Observations 

While  every  technical  assistance  system  funded  by  ED  has  a 
characteristic  personality,  that  of  the  laboratories  stands  out  dramatically 
from  the  others.     To  sum  up  the  advantage  that  the  other  systems  have  over 
laboratories,  there  is  something  to  be  said  for  knowing  what  you  are 
supposed  to  do- -and  with  whom.    For  the  laboratories,  forging  relationships 
with  a  broad  array  of  government  and  professional  entities,  many  of  which 
experience  their  own  shifts  in  personnel  and  priorities,  requires  a  level  of 
hard  work  that  the  other  assistance  providers  do  not  have  to  expend. 
Achieving  a  clear  identity  in  spite  of  a  diffuse  mission  and  diverse 
clientele  poses  difficulties  that  can  only  be  compounded  by  an  expectation 
for  rigorous  evaluation. 

From  another  point  of  view,  the  sweep  of  ambition  for  the  laboratories 
is  commendable  and  even  exciting.     The  breadth  of  their  mission  permits  the 
use  of  comprehensive  approaches  that  clients  of  the  other  programs  do  not 
experience.    The  other  programs'  forced  partnerships  with  specific  SEA 
personnel  undoubtedly  weaken  their  credibility  and  effectiveness  in  many 
situations  (even  while  strengthening  them  in  others).    And  ED's  growing 
efforts  to  hold  programs  ef  all  kinds  accountable  for  their  results  will 
find  the  laboratories  in  a  better  position  than  those  assistance  programs 
that  have  carried  out  relatively  pro  forma  evaluations. 

With  respect  to  indirect  service,  few  lessons  emerge  from  this 
comparative  analysis  of  the  laboratories  and  other  programs.     Since  the 
other  programs  do  not  really  offer  indirect  service,  they  suggest  no 
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principles  for  laboratories  to  follow  in  this  area.     I  can  suggest  only  the 
common-sense  notions  that  laboratories  will  probably  be  most  successful  with 
indirect  service  when  they  can  find  partners  with  (1)  a  relatively  stable 
commitment  to  a  well-defined  program  of  educational  improvement,  (2)  a  lack 
of  in-house  capacity  to  do  things  that  laboratories  can  do,  and  (3)  no 
particular  ambition  to  become  laboratories  in  the  next  funding  competition. 
The  lessons  that  laboratories  learn  about  indirect  service  will  not  be  of 
much  help  to  other  ED  assistance  systems  as  currently  constituted,  since 
those  systems  do  not  have  to  provide  indirect  service  and  probably  would  not 
choose  to  incorporate  it  into  their  work. 

In  general,  indirect  service  may  be  most  usefully  vieved  as  one  of 
several  strategies  for  increasing  the  efficiency  of  technical  assistance. 
Along  with  training  trainers  and  disseminating  model  programs,  working  "with 
and  through"  other  organizations  may  oe  an  approach  in  which  an  initial 
investment  does  yield  cost  savings  over  time.    After  an  investment  of  the 
time  and  patience  necessary  to  develop  interorganizational  relationships, 
the  payoff  comes  as  multiple  organizations  together  build  their  rapacity  as 
assistance  providers  and  develop  workable  divisions  of  labor.  However, 
there  seems  to  be  no  compelling  reason  to  adopt  indirect  service  as  the  only 
means  of  achieving  eff iciercies. 
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REGIONAL  EDUCATIONAL  LABORATORIES: 
THE  STRATEGY  OF  USASLfc  IGNORANCE 

William  N.  Dunn 
University  of  Pittsburgh 

INTRODUCTION 

The  Regional  Educational  Laboratory  Program  is  considerably  more  complex 
today  than  it  was  some  twenty-five  years  ago  when  the  first  laboratories  were 
established  under  Title  IV  of  the  Elementary  and  Secondary  Education  Act  (ESEA) 
of  1966.  In  those  early  years  the  Educational  Laboratories,  along  with  Research 
and  Development  Centers,  were  faced  with  the  apparently  simple  task  of  revitaliz- 
ing schools  by  generating  and  diffusing  new  knowledge  regarding  learning  and 
instruction  (see  Guthrie,  1989,  pp.  3-<0.  In  the  intervening  years  laboratories, 
working  in  an  increasingly  complex  environment  comprised  of  cT  verse  local 
educational  priorities  and  political  interests,  were  reorganized  along  regional 
lines.  To  be  sure,  the  process  of  regionalization  fostered  greater  responsive- 
ness to  states  in  that  fiscally  troubled  era  known  as  "creative  federalism. " 
Nevertheless,  the  process  of  regionalization  has  created  a  complex  tapestry  of 
conflicting  agendas  which  tend  to  complicate  the  further  development  of  a  common 
educational  mission. 

The  process  of  regionalization  has  been  attended  by  a  stunning  decline  of 
funds  available  to  the  nine  laboratories  and  its  sponsors,  the  National  Institute 
of  Education  and  (after  1985)  the  Office  of  Educational  Research  and  Improvement. 

NOTE:  Paper  prepared  for  a  special  issue  of  the  International  Journal  of  Educa- 
tional Research  and  commissioned  by  the  U.S.  Department  of  Education,  Office  of 
Educational  Research  and  Improvement.  Conclusions  and  interpretations  do  not 
reflect  the  official  positions  or  policies  of  xhe  contracting  agency. 
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The  laboratory  program,  like  other  federal  R£D  initiatives  designed  to  promote 
social  goals,  has  experienced  deep  fiscal  cuts  in  a  period  when  the  share  of 
total  federal  R&D  devoted  to  the  military  function  grew  from  51  percent  in  1975 
to  72  percent  in  1986  (National  Science  Board,  1985,  p.  226).  The  Reagan-era 
military  build-up,  an  integral  part  of  what  many  see  as  a  nascent  "military-post- 
industrial  complex",  evidently  has  been  purchased  at  the  expense  of  education  and 
other  social  programs. 

Given  this  unhappy  conjunction  of  circumstances,  it  is  perhaps  readily 
apparent  why  the  mission  of  the  Regional  Educational  Laboratory  Program  has 
changed  over  the  years.  Commencing  as  a  reasonably  funded  R&D  enterprise,  the 
program  soon  became  an  undercapitalized  knowledge  transfer  operation,  what  some 
see  as  an  "information  utility"  responsible  for  improving  schools  but  constrained 
in  this  effort  by  inadequate  fur  and  restrictive  policies  which  confine 
laboratories  to  working  "with  and  through"  state  and  local  educational  agencies. 
Unclear,  however,  is  how  the  laboratory  program  functions  as  a  vehicle  for  the 
transfer  of  educational  knowledge.  How  do  individual  laboratories  and  the 
program  as  a  whole  link  or  mediate  producers,  users,  and  intended  beneficiaries 
of  new  educational  knowledge?  How  does  the  laboratory  program  compare  with 
similar  or  analogous  initiatives  in  areas  such  as  agriculture,  industry,  defense, 
and  health?  What  new  strategies  might  be  developed  to  enhance  the  performance  of 
regional  educational  laboratories  in  improving  schools?  How  can  regional 
educational  laboratories  improve  their  performance  in  transferring  knowledge 
which  helps  revitalize  American  schools?  , 

In  responding  to  these  and  reloted  questions  this  paper  draws  on  OERI 
program  documents  and  recent  syntheses  of  research  on  knowledge  transfer, 
including  Beal,  Dissanayake,  and  Konoshima  (1986),  Dunn  and  Holzner  (1988),  Dunn, 
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Holzner,  and  Zaltman  (1985),  Glaser,  Abelson,  and  Garrison  (1983),  and  Huberman 
(1987,  1989).  The  central  argument  of  the  paper  is  that  regional  educational 
laboratories  are  vital  elements  of  s  complex  social  system  of  educational 
knowledge.  The  organized  complexity  of  this  system  renders  firm  programmatic 
commitments  to  improving  schools  through  knowledge  transfer  activities  hazardous; 
it  also  raises  doubts  about  the  appropriateness  of  school  improvement  as  a 
standard  of  accountability,  since  the  resources  presently  available  to  laborator- 
ies do  not  permit  them  to  impact  directly  upon  schools.  Assuming  that  a  dramatic 
increase  in  laboratory  funding  is  unlikely,  it  may  be  prudent  to  focus  resources 
on  the  design  and  conduct  of  quasi-experimental  field  studies  involving  alterna- 
tive strategies  for  transferring  educational  R&D  to  those  in  need.  In  contrast 
to  the  current  practice  of  "random  mediation, "  these  quasi-experimental  interven- 
tions would  represent  a  form  of  "systematic  mediation"  designed  to  contribute  in 
important  ways  to  the  expansion  of  institutional  and  system-wide  learning  about 
the  efficacy  of  alternative  knowledge  transfer  strategies.  But  the  immediate  aim 
of  systematic  mediation  is  not  to  transfer  what  Lindblom  and  Cohen  (1979)  term 
usable  knowledge,  but  rather  to  identify  what  Ravetz  (1987)  calls  usable  ignor- 
ance. The  strategy  of  usable  ignorance,  which  involves  the  coding,  classifica- 
tion, and  specification  of  gaps  in  our  knowledge  about  effective  approaches  to 
synthesizing,  developing,  and  disseminating  educational  R&D,  can  help  set  the 
research  agendas  of  the  educational  research  community  and  shape  the  policy- 
making and  practice  agendas  of  state  and  local  policy  makers,  teachers,  and  other 
stakeholders  in  school  improvement. 
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LABORATORIES  IN  THE  KNOWLEDGE  SYSTEM  OF  EDUCATION 
The  current  and  historical  performance  of  the  Regional  Educational  Labora- 
tory program  can  be  investigated  in  several  ways,  for  example,  by  examining 
changes  in  the  political  mandate,  legal  charter,  and  mission  of  laboratories 
(OERI,  1988),  or  by  exploring  the  organizational  and  political  conditions  which 
have  enabled  and  constrained  their  effectiveness  (Guthrie,  1989).  Although  these 
approaches  are  no  doubt  valuable  and  important,  the  laboratory  program  also  can 
be  investigated  as  a  system  of  norms,  values,  roles,  and  resources  forming  the 
social  arrangements  within  which  knowledge-related  activities  are  carried  out. 
Here,  the  central  organizing  construct  is  that  of  the  social  system  of  knowledge, 
or  knowledge  system  for  short,  which  refers  to  the  social  distribution  of 
knowledge-related  functions  (Holzner  and  Marx,  1979,  p.  175). 

Knowledge  Functions 

The  regional  educational  loborotory    program,    like    all    knowledge  systems, 

performs    several    interrelated    knowledge    functions:       mandating,  production, 

structuring,  storage,  distribution,  and  utilization  (see    Holzner,  1983;  Holzner, 

Dunn,  and  Shahidullah,  1987). 

°  Knowledge  Mandating,  The  laboratory  program  involves  decisions  obout 
what  kinds  of  research  should  be  mandated  and,  indeed,  whether  research 
of  any  kind  is  the  proper  function  of  laboratories.  The  priorities  of 
the  program  since  1985  reflect  the  decision  that  laboratories  should 
function  primarily  as  regional  "information  utilities."  As  such,  the 
research  conducted  by  laboratories  should  be  limited,  short-term  and 
applied  in  nature  (NIE,  1985,  p.  25). 

o  Knowledge  Production.  Although  laboratories  are  not  responsible  for 
conducting  basic  research,  they  are  formal] y  charged  with  the  conduct 
of  applied  research  and  development  which  yields  systematic  assessments 
of  effective  approaches  to  dissemination  and  school  improvement  (NIE, 
1985,  p.  13).  In  practice,  the  bulk  of  such  new  knowledge  appears  to 
be  based  on  "random  mediation,"  that  is,  the  initiation  of  dissemina- 
tion activities  which  are  evaluated  by  meons  of  casual  empiricism  and 
ad  hoc  analysis. 
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o  Knowledge  Strusturing.  Laboratories  structure  existing  knowledge  by 
synthesizing,  evaluating,  and  transforming  into  potentially  actionable 
products  basic  and  applied  research  produced  by  R&D  Centers,  univer- 
sities, and  other  institutions  within  the  knowledge  system.  Newslet- 
ters, policy  papers,  research  syntheses,  and  other  laboratory  products 
represent  efforts  to  structure  (and  restructure)  knowledge  which  is 
believed  relevant  to  school  improvement. 

o  Knowledge  Storage.  Laboratories  use  conventional  filing  systems  as 
well  as  computerized  records  to  store  knowledge  which  has  been  produced 
locally  and  by  others.  The  creation  of  computer  files  comprised  of 
annotations  of  existing  written  reports,  or  of  available  computer 
software,  involves  the  storage  of  knowledge. 

o  Knowledge  Distribution.  Laboratories  distribute  to  various  stakehold- 
ers, including  state  and  local  educational  agencies,  knowledge  which 
has  been  produced,  structured,  and  stored.  The  distribution,  dissemin- 
ation, or  communication  of  such  knowledge  by  laboratories  is  intended 
to  improve  schools. 

o  Knowledge  Utilization.  Although  laboratories  themselves  utilize  the 
knowledge  they  produce,  structure,  store,  and  distribute  to  others,  the 
principal  direct  users  of  this  knowledge  are  the  state  and  local 
agencies  with  and  through  whom  laboratories  an*  mandated  to  work. 
Unless  knowledge  is  utilized  in  sorre  way  to  improve  schools,  its 
dissemination  by  laboratories  is  practically  meaningless,  although 
utilization  alone  by  no  means  guarantees  a  specific  impact  (positive  or 
negative)  on  schools. 


Knowledge  Structures 

Regional  Educational  Laboratories  perform  these  functions  in  markedly 
different  ways.  In  the  area  of  improving  state-level  educational  policies,  for 
example,  only  five  of  nine  laboratories  report  that  they  specialize  in  functions 
of  knowledge  structuring,  storage,  and  distribution,  as  represented  by  the 
categories  "data  base  development"  and  "data  base  reports"  presented  by  Mason 
(1988,  Table  7).  Although  laboratories  p  duce  new  knowledge,  few  appear  to 
conduct  systematic  research  on  their  own  role  r,id  effectiveness  in  developing  and 
disseminating  products  of  educational  research  and  fostering  their  utilization. 
Evidently,  laboratories  could  learn  a  good  deal  more  about  their  own  performance 
as  knowledge-mediating    structures    (Holzner,    Dunn,    and    Shahidulloh,     4987)  or 


intermediaries  in  the  so-called  market  for  educational  knowledge  (Sundquist, 
1978). 

Laboratories  thus  appear  to  have  a  limited  capacity  for  monitoring  and 
evaluating  their  own  knowledge  system  interventions,  interventions  which  are 
designed  co  link  basic  and  applied  educational  researchers,  on  one  hand,  and 
educational  policy  makers  and  practitioners  on  the  other.  One  possible  explana- 
tion for  this  limited  capacity  has  to  do  with  the  unique  professional  culture  of 
laboratories,  which  is  significantly  different  from  that  of  R&D  Centers  and 
research  universities,  both  of  which  are  formally  committed  to  the  norms,  values, 
and  interests  of  scientific  communities.  In  contrast  to  scientific  communities 
in  which  new  \nowledge  has  intrinsic  intellectual  value  (see  Machlup,  1980), 
laboratories  represent  c  special  form  of  social  and  cultural  organization  which 
MacRae  (1987)  calls  a  "technical  community."    A  technical  community  is 

a  group  of  experts  who  deal  with  laymen's  practical  problems,  conduct 
related  research,  and  subject  both  these  activities  to  independent  mutual 
quality  control.  Such  a  group  resembles  a  scientific  community  except  that 
it  is  guided  by  practical  rather  than  purely  theoretical  criteria  of 
excellence;  and  concerned  not  only  with  internal  standards  but  also  with 
performing  functions  for,  and  thus  interacting  with,  laymen  (MacRae,  1987, 
P.  5). 

As  technical  communities  laboratories  are  the  principal  intermediaries  in  a 
complex  knowledge  system  in  which  distinct  knowledge  functions  are  distributed 
among  different  institutional  structures.  These  functions  and  structures  are 
sometimes  viewed  as  forming  a  linear  or  quasi-linear  arrangement,  where  one 
structure  performs  a  specialized  knowledge  function  which  is  followed,  in  turn, 
by  the  next  structure  performing  its  function,  ond  so  on.  This  view  is  eloquent- 
ly stated  by  Rothman  (1980,  p.  16),  who  employs  the  metaphor  of  a  missing  lumber 
mill  to  represent  obstacles  to  the  effective  transfer  and  utilization  of  knowl- 
edge in  education  and  other  human  service  areas: 
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The  social  science  researchers  have  gone  into  the  forest  of  knowledge, 
felled  a  good  and  sturdy  tree,  and  displayed  tho  fruits  of  their  good  work 
to  one  another.  A  few  enterprising,  application-minded  lumber jack  5  have 
dragged  some  logs  to  the  river  and  shoved  them  off  downstream  ( "diffusion" 
they  call  it).  Somewhere  down  river  the  practitioners  are  manning  the 
construction  companies. .on  the  whole  they  are  sorely  lacking  in  lumber  in 
the  various  sizes  and  forms  they  need  to  do  their  work  properly.  The 
problem  is  that  someone  has  forgotten  to  build  the  mill  to  turn  the  logs 
into  lumber  in  all  its  usable  forms.  The  logs  continue  to  pile  up  at  one 
end  of  the  system  whild  the  construction  companies  continue  to  make  do  at 
the  other  end. . . . 

The  strength  of  this  metaphor  is  that  it  emphasizes  the  important  rol*  of 
mediating  structures  in  linking  producers  and  users  of  knowledge.  The  limitation 
of  the  metaphor  is  that  it  assumes  a  process  which  is  essentially  linear, 
unidirectional,  and  irreversible. 

The  metaphor  of  the  missing  lumbermill  does  not  accommodate  knowledge 
systems  in  which  different  institutional  structures  perform  one  or  many  knowledge 
functions  which  are  arranged  in  the  complex  spatial  and  temporal  patterns 
described  by  Reisman  (1987)  ond  applied  to  the  area  of  knowledge  systems  account- 
ing by  Dunn,  Holzner,  Shahidullah,  and  Hegedus  (1987): 

o  Serial.  A  mediating  structure  performs  specialized  functions  which  have 
one  predecessor  and  one  successor  in  a  series,  for  example,  when  the 
distribution  of  new  educational  knowledge  is  preceded  by  prior  basic  or 
applied  research  and  succeeded  by  knowledge  utilization  by  practi- 
tioners. A  predecessor  or  successor  function  may  have  its  own  prede- 
cessor and  successor,  creating  an  extended  series  of  functions  which 
form  a  chain-like  arrangement  which  is  linear,  unidirectional,  and 
irreversible. 

o  Parallel.  A  mediating  structure  performs  a  number  of  parallel  knowledge 
functions  which  have  .  ?  clear  predecessor  or  successor,  or,  by  exten- 
sion, several  structures  perform  two  or  more  parallel  series  of 
functions.  For  example,  two  parallel  series  involving  the  production, 
distribution,  and  utilization  of  educational  research  may  be  performed 
by  different  programs  within  the  same  laboratory,  or  by  two  or  more 
laboratories.  The  resultant  arrangement,  while  unidirectional  and 
irreversible,  is  co-linear. 

o  Assembly.  A  mediating  structure  performs  a  specialized  function  which 
involves  the  assembly  of  results  from  any  number  of  predecessors,  for 
example,  when  new  educational  knowledge  is  assembled  from  multiple 
sources  which    are    "scientific,"    "professional,"    and  "experiential." 
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When  laboratories  assemble  knowledge  in  this  fashion  the  resultant 
pattern,  while  irreversible,  is  multi-linear  and  multi-directional. 


o  Arborescent.  A  mediating  structure  performs  a  specialized  function  with 
any  number  of  successors  which  form  the  branches  of  a  tree,  for 
example,  when  the  conclusions  of  an  educational  research  project  are 
developed  in  the  form  of  multiple  products.  Laboratories  often  develop 
products  in  this  arborescent  fashion,  forming  a  tree-like  arrangement 
which  is  multi-linear  and  multi-directional,  although  it  remains 
irreversible. 

o  Cyclic.  A  mediating  structure  performs  specialized  functions  with  a 
number  of  predecessors  and  successors  which  are  cyclically  related, 
with  feedback  loops  among  functions.  In  most  mediating  structures, 
functions  are  cyclically  related,  not  linear,  although  it  is  frequently 
difficult  to  establish  their  temporal  order.  For  example,  the  approach 
employed  by  laboratories  to  develop  and  disseminate  research  products 
affects  their  utilization  by  practitioners,  who  in  turn  may  affect 
subsequent  development  and  dissemination  efforts  by  providing  evalua- 
tive feedback.  The  resultant  arrangement,  which  is  expressly  non- 
linear, can  be  found  as  well  in  parallel,  assembly,  and  arborescent 
structures  which  have  feedback  loops. 

Organized  Complexity 

Knowledge  systems  may  be  characterized  in  terms  of  organized  complexity,  a 
state  or  condition  in  which  the  interpenetration  of  serial,  parallel,  assembly, 
arborescent,  clic    patterns    forms    a    complex    but    organized  arrangement. 

While  sometimes  erroneously  equated  with  random  or  chaotic  processes,  organized 
complexity  is  usefully  represented  as  a  complex  river  delta  which  systems  analyst 
Stafford  Beer  (1981,  p.  30)  calls  anastomotic  reticulum.  In  this  complex  river 
delta  many  streams  flow  to  the  sea  or  to  the  flood  plain,  with  the  streams 
branching  repeatedly,  flowing  into  each  other.  Until  we  comprehend  the  organized 
complexity  of  the  delta  it  is  not  possible  to  forecast  the  likely  route  of  a 
pailful  of  water  dumped  upstream  in  the  river;  nor  is  it  possible  to  trace  the 
route  by  which  a  pailful  of  water  drawn  from  the  sea  arrived  there.  While  the 
water  moves  in  a  central  direction  towards  the  sea,  the  system  continuously 
changes  as  a  consequence  of    dissipative    and    self -organizing    structures.  Old 
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streams  disappear  and  new  ones  form;  order  emerges  out  of  chaos  (compare  Prigo- 
gine  and  Stengers,  1984). 

The  imagery  of  the  river  delta  punctuates  some  of  the  profound  difficulties 
which  arise  when  observers  try  to  trace  practical  problem  solving  to  pri**** 
knowledge  functions,  but  without  f ir? t  attempting  to  comprehend  the  organized 
complexity  of  the  mediating  structures  and  functions  which  form  the  knowledge 
system.  Observers  such  as  Lindblom  and  Cohen  (1979),  Weiss  and  Bucuvalas  (1980), 
and  Glaser,  Abelson,  and  Garrison  (1983),  for  example,  report  essentially  weak  or 
equivocal  relationships  between  the  production  and  utilization  of  knowledge  in 
education  and  many  other  areas  of  social  practice.  But  weak  or  equivocal 
relationships  also  have  been  reported  in  science  and  technology  intensive  areas 
such  as  agriculture,  industry,  health,  and  defense  which  are  widely  but  mistaken- 
ly believed  to  be  unambiguous  beneficiaries  of  federal  investments  in  research 
and  development.  A  recent  international  project  devoted  to  the  design  of  science 
and  technology  impact  indicators  (Dunn  and  Holzner,  1987),  while  yielding  several 
prototype  indicator  systems,  produced  few  stable  and  empirically  grounded 
conclusions  about  specific  social  and  economic  impacts  of  the  natural  and  social 
sciences  in  areas  of  government  information  policy  (Bearman,  1988),  industry 
(Feller,  1987),  health  (Kochen,   1988),  and  education  (Rutherford,  1987). 

Organized  complexity  thus  appears  to  generate  weak  or  equivocal  functional 
relationships  in  many  of  the  most  important  knowledge  systems.  While  two  decades 
of  research  (see  HavelocK,  1969)  suggests  that  the  strength  of  linkages  among 
elements  of  such  systems  is  a  critical  aspect  of  knowledge  transfer,  such 
functional  linkages  often  have  been  found  to  be  weak  or  equivocal.  When 
functional  linkages  are  weak  or  equivocal,  it  is  difficult  to  predict  the  social 
and  economic  impact  of    scientific  knowledge.      Illustrations    of  this  difficulty 
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may  be  found  in  areas  of  agriculture,  defense,  industry,  and  health: 


o  Agriculture.  One  of  the  most  well-funded  and  ambitious  knowledge 
systems  is  that  of  the  Cooperative  Extension  Service  (CES)  of  the  U.S. 
Department  of  Agriculture.  Although  the  "agricultural  model"  has  many 
unique  characteristics  that  cannot  be  generalized  to  other  knowledge 
systems — for  example,  the  relative  simplicity  of  seeds,  fertilizers, 
and  other  material  innovations — the  CES  appears  to  have  performed 
reasonably  well  (Havelock,  1969,  p.  3-35).  At  the  same  time,  recent 
studies  of  the  economic  impact  of  the  CES  (e.g.,  Weaver,  1985)  suggest 
that  the  prediction  of  igricultural  improvements  on  the  basis  of 
investments  in  R&D  is  problematic.  Although  there  is  a  positive 
relationship  between  indicators  of  agricultural  output  (e.g.,  sales) 
and  indicators  of  R&D  (e.g.,  expenditures),  the  absence  of  specific 
measures  of  the  process  of  diffusion  makes  these  indicators  at  best 
"stochastic  measures  of  the  ur observable  input  characteristics  and 
output  flows  involved  in  the  R&D  process"  (Weaver,  1985,  p.  14) . 

o  Defense.  Large  investments  in  the  knowledge  system  of  military  R&D  are 
often  justified  on  the  basis  of  subsequent  economic  impacts  on  the 
civilian  economy.  The  C5-A  transport,  for  example,  significantly 
affected  the  development  of  the  Boeing  707  and  other  improvements  in 
civil  aviation.  Yet  as  Rosenberg  cautions,  the  opportunity  costs  of 
military  R&D  to  the  American  economy  appear  to  have  been  substantial. 
"The  economic  growth  experience  of  the  United  States  in  the  past  few 
decades,  by  comparison  with  Japan,  Germany,  and  other  advanced  indus- 
trial countries,  does  not  obviously  support  the  presumption  that  lcrge 
expenditures  on  military  R&D  have  improved  its  relative  economic 
performance"  (Rosenberg,  1985,  p.  42). 

d  Health.  Advances  in  biomedical  R&D  have  enlarged  capacities  to  prevent 
and  treat  infectious  diseases.  Although  the  decline  in  mortality  from 
infectious  diseases  is  seen  by  many  as  the  most  significant  medical 
achievement  of  modern  times,  a  careful  investigation  of  historical 
evidence  "seems  to  show  unambiguously  that  medical  science  has  made 
only  a  marginal  contribution  to  this  practical  achievement"  (Mulkay, 
1979,  p.  73).  Observing  that  the  long-term  decline  in  deaths  from 
cholera,  tuberculosis,  typhus  and  other  infectious  diseases  occurred 
many  years  before  the  introduction  of  science-intensive  technologies 
into  medical  practice,  Mulkay  (1979)  and  Kncrr-Cetina  (1981)  argue  that 
basic  and  applied  science  typically  exert  weak  effects  on  health 
improvements. 

d  Industry.  Scientific  R&D  may  be  viewed  as  the  engine  which  drives 
industrial  improvements  of  many  kinds.  At  the  same  time,  detailed 
studies  such  as  Wealth  From  Knowledge :  A  Study  of  Innovation  in 
Industry  (Langrish  et  al.,  1972)  document  that  dozens  of  award-winning 
industrial  innovations  in  the  United  Kingdom  ha</e  been  weakly  related 
(if  at  all)  to  prior  advances  in  basic  or  applied  science.  In  the 
United  States,  this  conclusion  would  seem  to  be  supported  by  Griliches 
(1984,  p.  18),  who  observes  that  relations  between  scientific  R&D  and 
productivity    "can    be    affected    only    indirectly    and    imperfectly  by 
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supporting  science  in  general  and  basic  research  in  particular  and  by 
pursuing  wise  macroeconomic  policies."  This  general  claim  may  be 
related,  in  turn,  to  the  specific  conclusion  that  "policies  intended  to 
affect  the  technologicol  infrastructure  through  the  use  of  various 
transaction  devices  (grants,  contraccs,  procurements,  mandating  of 
technology,  etc.)  are  based  largely  on  legal  anc1  accounting  criteria, 
and  have  little  demonstrated  relationship  to  innovation  outcomes" 
(T^rnatzky  et  al.,  1983,  p.  221). 

As  these  examples  suggest,  the  organized  complexity  of  knowledge  systems  in 
agriculture,  defense,  health,  and  industry  frequently  involves  weak  or  ambiguous 
functional  relationships.  Knorr-Cetina  (1981)  and  Mulkay  (1979),  in  using  the 
relationship  between  biomedical  research  and  infectious  diseases  as  a  critical 
case,  go  beyond  ad  hoc  accounts  of  knowledge  systems  and  develop  a  plausible 
general  explanation  of  the  sources  of  such  organized  complexity  (also  see 
Prigogine  and  Stengers,  1984).  Observing  that  most  of  the  1850-1970  decline  in 
deaths  from  infectious  diseases  occurred  prior  to  the  adoption  of  science- 
intensive  technologies  by  practitioners,  they  argue  that  social  practice  is 
underdetermined  by  basic  and  applied  science.  Scientific  and  technological 
knowledge  tends  to  dissipate  in  complex  social  systems  where  functional  linkages 
are  weak  and  where  sociol  practice  is  temporal,  contextual,  and  self -organizing 
(Knorr-Cetina,  1981).  In  medicine  as  well  as  education,  basic  research  is  used 
as  a  foundation  for  technological  innovation  only  after  extensive  reformulation. 
"In  order  to  make  basic  science  'work,'  it  has  to  be  radically  reinterpreted  in 
accordance  with    the  requirements    of  the  social  context  of  practical  application 

  judgments  of  cognitive  adequacy  vary  with  social  context"  (Mulkay,     1979,  p. 

71).  These  processes  of  radical  reinterpretation  make  it  difficult  to  disen- 
tangle the  effects  of  science  and  other  forms  of  specialized  knowledge  from  the 
effects  of  experiential  or  craft  knowledge  originating  in  contexts  of  practice, 
thus  complicating  efforts  to  justify  research  in  terms  of  its    practical  utility. 
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Rosenberg  (1986)    provides  a    summary  statement  which  establishes  a  general  base- 


line for  assessing  the  impact  of  science-intensive  technologies  on  industry, 
agriculture,  heolth,  defense,  and  education: 

Perhaps  the  reason  we  do  so  poorly  at  predicting  the  impact  of  technological 
change  is  that  we  are  dealing  with  an  extraordinarily  complex  and  inter- 
dependent set  of  relationships.  We  should,  however,  be  able  to  do  a 
somewhat  better  job  of  it  in  the  future,  if  only  by  developing  a  better 
appreciation  of  some  of  the  reasons  why  we  have  done  so  badly  in  the  past 
( Rosenberg ,  1 986 ,  p .  17). 


By  recognizing  the  organized  complexity  or  knowledgo  systems  it  is  possible 
to  comprehend  why  research-based  educational  knowledge,  whether  basic  or  applied, 
loses  force  and  direction  as  it    makes    its    way    from    producers    through  inter- 


tendency  of  knowledge  to  dissipate  as  a  consequence  of  self-organizing  structures 
and  functions.  The  more  pronounced  the  tendency  toward  dissipation,  the  stronger 
the  intervention  required  to  transfer  knowledge  with  the  aim  of  producing  a 
desired  effect. 

Economics  of  Weak  Interventions 

The  finoncial  resources  available  to  OERI  and  the  laboratory  program  govern 
the  extent  to  which  promising  knowledge  transfer  interventions  can  be  successful- 
ly mandated.  The  strong  interventions  required  to  forestall  o:-  to  minimize  the 
dissipation  of  educational  knowledge  are  possible  only  with  adequate  levels  of 
funding.  Yet  the  funds  available  to  OERI  and  the  laboratory  program  permit  only 
weak  interventions  which,  lacking  in  potency,  are  unlikely  to  succeed  in  the 
transfer  and  utilization  of  knowledge  for  school  improvement.  As  Rutherford 
(1987)  observes,  the  mediating  structures  established  by  NIE/OERI  in  the    form  of 


THE  DISSIPATION  OF  EDUCATIONAL  KNOWLEDGE 


mediaries 


to  users. 


The    more    complex  the  knowledge  system,  the  greater  the 
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the  regional  educational  laboratories  and  centers  have  made  little  progress  in 
the  last  quarter  century  toward  placing  the  conduct  of  elementary  and  secondary 
education  on  a  scientific  basis.  Among  several  plausible  explanations  for  this 
lack  of  progress  it  appears  that  laboratories,  in  contrast  to  the  massive 
resources  provided  to  land-grant  universities  under  the  Morrill  Act,  are  based  on 
mechanisms  which  "are  too  feeble  to  have  much  impact  on  such  a  huge  enterprise  as 
education"  (Rutherford,  1987,  p.  308). 

The  feeble  chara-^jr  of  these  mechanisms  is  evident  in  the  continuous 
decline  of  the  budget  of  the  regional  educational  laboratory  program  since  1973 
(Table  1).  In  constant  (1972)  dollars  the  budget  of  the  laboratory  program  fell 
from  $22  million  in  fiscal  1973  to  $6.5  million  in  fiscal  1988,  a  decline  of  more 
than  70  percent.  During  the  same  period  the  budget  of  the  National  Institute  of 
Education/Office  of  Educational  Research  and  Improvement  fell  by  more  than  79 
percent,  from  $98.8  million  in  1973  to  $20.6  million  in  1988.  While  the  budgets 
of  NIE/OERI  and  the  laboratory  program  declined,  federal  government  expenditures 
on  military  Rio  increasej  by  approximate^  90  percent,  from  $8.6  billion  in  1973 
to  $16.2  billion  in  1988.  Nearly  all  of  this  increase  in  military  R&D  and 
roughly  one-half  of  the  decrease  in  funding  for  OERI  and  the  laboratories 
occurred  during  the  Reagan  presidency.  To  place  these  changes  in  perspective,  to 
restore  laboratory  funding  to  its  1973  level  would  require  a  tripling  of  the 
fiscal  1988  budget. 

Random  Mediation 

Although  laboratories  are  designed  to  mediate  the  worlds  of  producers  and 
users,  it  is  presently  unclear  how  they  perform  functions  of  knowledge  mandating, 
production,  structuring,  storage,  distribution,  and  utilization.  The  descriptive 
synthesis    of    laboratory    approaches    and    activities    prepared  by  Mason  (198d), 
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together  with  program  summaries  provided  by  each  of  the  nine  laboratories  (OERI, 
1989),  suggest  that  few  laboratories  are  identical  or  even  similar  in  the 
functions  they  perform.  Observed  differences  between  laboratories  have  been 
viewed  as  a  natural  and  appropriate  response  to  regional  diversity,  as  a  means  to 
adapt  creatively  to  a  complex  environment.  Conversely,  these  differences  also 
may  be  seen  as  a  failure  to  adhere  to  common  standards  of  performance. 

Regrettably,  neither  of  these  views  is  correct,  since  creative  adaptations 
to  com^.dx  environments  can  and  should  be  linked  to  common  standards  of  assess- 
ment. Consider,  for  example,  the  1985  Request  for  Proposals  (RFP)  requiring  that 
laboratories  "contribute  to  knowledge  about  effective  strategies  for  improving 
education  through  carefully  designed  studies  of  how  its  own  dissemination  and 
improvement  efforts  are  working"  (NIE,  1985).  Provided  that  laboratories  conduct 
such  carefully  designed  studies,  variations  between  laboratories  can  only 
strengthen  efforts  to  cross-validate  and  evaluate  the  performance  of  competing 
dissemination  and  improvement  strategies. 

Inter-strategy    variation    is    therefore    essential    to    the    success  of  the 

laboratory  program.    For    example,    the    deliberate    maximization    of  differences 

between  alternative    dissemination  strategies  can  help  alleviate  a  severe  problem 

identified  by  Lieb-Brilhart  (1989,  p.  1)    on  the    basis  of    a  1988    report  to  the 

House  Committee  on  Education  and  Labor  of  the  U.S.  Congress: 

...there  has  yet  to  emerge  a  national  dissemination  policy  of  exploiting,  in 
a  coordinated  fashion,  the  strengths  of  existing  dissemination  systems  ... 
as  well  as  identifying  what  other  dissemination  strategies  are  needed  to 
meet  the  needs  of  today's  schools  (Subcommittee  on  Select  Education,  1988, 
p.  12). 

Most  laboratories  have  not  commissioned  or  conducted  carefully  designed 
dissemination  studies  which    maximize    inter-strategy    variation.  When  well- 

designed  studies    have  been    carried  out,  for  example,  the  tracer  studies  commis- 


sioned  by  the  Appalachian  Educational  Laboratory,  the  use  of  a  special  method- 
ology precludes  comparisons  across  strategies  employed  in  other  regional  labora- 
tories. In  fact,  the  majority  of  regional  laboratories  appear  to  engage  in  a 
form  of  random  mediation,  as  distinguished  from  the  kind  of  systematic  mediation 
proposed  in  the  1985  RFP  as  a  promising  line  of  applied  research  involving 
"systematic  assessment  of  dissemination  and  school  improvement  activities  to 
identify  approaches  that  are  most  effecti/e"  (National  Institute  of  Education, 
1985,  p.  13). 

Systematic  mediation  can  and  should  employ  the  logic  of  quasi-experimental 
reasoning,  whether  in  the  form  of  the  field  experiment  (see,  e.g.,  Cook  and 
Campbell,  1979)  or  as  case  study  analysis  (Yin,  1985).  Both  forms  of  quasi- 
experimentci  reasoning,  apart  from  surface  differences  in  technique,  are  intended 
to  address  the  equivocality  of  knowledge  claims  in  complex  settings  of  practice. 
Quasi-experimentation  is  a  potent  approach  to  systematic  mediation  because  the 
equivocality  of  causal  inferences  involving  presumed  impacts  of  dissemination  and 
improvement  strategies  necessitates  methods  for  systematically  ruling  out  the 
rival  hypotheses  which  pervade  renl-^jfe  policy  settings  (see  Campbell,  1988,  pp. 
315-333). 

For  every  hypothesis  that  educational  R&D  is  (or  is  not)  responsible  for  a 
practice  irprovement  we  typically  must  rule  out  numerous  rival  hypotheses 
involving  knowledge-mediating  functions  and  structures  (see  Dunn,  1986). 
Policymakers  and  practitioners  do  not  immediately  or  automatically  utilize 
educational  R&D  to  make  practice  improvements;  nor  is  there  any  obvious  positive 
or  negative  relationship  jetween  the  improvement  of  schools,  on  one  hand,  and  the 
production,  structuring,  storage,  distribution,  and  utilization  of  educational 
R&D  on    the  other.      To    be  sure,    there  is    a  certain  surface  plausibility  about 
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claims  that  educational  knowledge  presented  in  the  form  of  such  documents  as  What 
Works;  Research  About  Teaching  and  Learning  (U.S.  Department  of  Education,  1986) 
facilitates  school  improvement.  On  closer  examination,  however,  such  claims 
reflect  whuc  has  been  called  a  knowledge-driven  model  of  research  utilization 
(Weiss,  1977;  Yin  and  Moore,  1988),  a  model  which  assumes  that  educational  R&D  is 
the  primary  or  sole  source  of  practice  improvements.  The  knowledge-driven  model 
unwittingly  ignores  the  organized  complexity  of  knowledge  systems,  along  with  the 
tangled  interpenetration  of  specific  knowledge  functions  jnd  structures,  thereby 
assuming  a  direct  or  unmediated  relationship  between  the  production  of  knowledge 
and  its  impact  on  intended  users. 

An  important  variant  of  the  knowledge-driven  model  is  the  simple  expected 
utility  model  frequently  employed  to  estimate  the  probable  impact  of  producing 
research-based  knowledge  or  information  (see  MacRae,  1985,  p.  11).  For  example, 
the  production  of  R&D  has  a  total  cost,  c,  which  includes  expenses  incurred  for 
collecting,  anolyzing,  and  interpreting  data  and  reporting  the  conclusions  or 
recommendations  in  some  appropriate  form.  The  probability  that  the  conclusions 
or  recommendotions  will  make  a  difference  is  p,  while  the  magnitude  of  this 
difference,  d,  represents  its  positive  impact  over  and  above  the  benefit,  b, 
which  would  have  been  obtained  without  producing  educational  R&D.  The  magnitude 
of  the  difference,  d,  may  be  added  to  the  original  benefit,  b,  to  give  an 
estimate  p(b+d)  of  the  net  impact  or  value  added  by  producing  R&D. 

The  simple  expected  utility  model,  while  expressed  formally  in  terms  of 
symbolic  nototion  (c,p,d,b),  supplies  a  reasonable  approximation  of  informal 
processes  of  reasoning  employed  by  policymakers  facing  questions  about  the  costs 
and  practical  benefits  of  educationol  R&D.  But  the  simple  expected  utility 
model,  whether    applied  formolly    or  os    part  of  the  tacit  logic-in-use  of  policy 
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makers,  ignores  the  positive  and    negative    impacts    of    mediating    functions  and 


systematically  by  expanding  the  simple  expected  utility  model  to  include  posi- 
tive, negative,  and  null  effects  of  utilizing  educational  R&D.  Here  we  estimate 
the  probability  that  utilizing  as  well  as  producing  educational  R&D  will  result 
in  positive  impacts,  no  change,  and  negative  impacts  (Figure  1).  In  some  cases 
involving  questionable  or  erroneous  research,  the  non-utilization  of  R&D  can  have 
positive  effects. 


The  expanded  expected  utility  model,  while  it  incorporates  the  probable 
effects  of  utilizing  and  not  utilizing  educational  R&D,  does  not  include  the 
other  knowledge-mediating  functions  of  mandating,  structuring,  storage,  and 
distribution.  Even  if  these  additional  functions  were  included,  we  have  yet  to 
develop  an  empirically  well-grounded  theory  of  knowledge  applications  (Dunn, 
1986,  p.  198).  In  the  absence  of  such  a  theory  the  knowledge  required  to 
calculate  such  expected  utilities  can  be  acquired  on  the  basis  of  anecdotal 
evidence  and  trial-and-error  learning  in  practice  settings,  that  is,  on  the  basis 
of  what  we  have  called  "random  mediation."  Alternatively,  this  requisite 
knowledge  can  be  acquired  on  the  basis  cf  quasi-exoerimental  studies  involving 
"systematic  mediation. "  As  matters  now  stand,  however,  neither  the  simple  nor 
the  expanded  expected  utility  model  enables  plausible  causal  inferences  about  the 
impact  of  mediating  functions  and  structures  on  school  improvement. 

To  assess  the  impact  of  these  mediating  functions  and  structures  we  require, 
in  addition  to  quasi-experimental  field  research,  a  framework  which  identifies 
the  many  rival  hypotheses  which  have  been  offered  to  challenge  claims  about  the 
impact  of  educational  R&D  on  school    improvement  (see,    e.g.,  Dunn,    Holzner,  and 


structures. 


These    mediating    functions    and    structures    can    be  investigated 


[Figure  1  about  here] 
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Zaltman,  1985;  Dunn,  Halzner,  Shahidullah,  and  Hegedus,  1987;  Glaser,  Abelsan, 
and  Garrison,  1983;  Huberman,  1987;  Rutherford,  1987).  These  rival  hypotheses 
represent  threats  ta  the  plausibility  of  claims  that  observed  impacts  an  schools 
are  due  ta  variations  in  aspects  of  one  ar  mare  af  the  following  functions: 
mandating,  production,  structuring,  storage,  distribution,  utilization.  Table  2 
presents  a  sample  of  these  rival  hypotheses,  which  represent  potential  sources 
and  forms  of  error  in  assessing  the  impact  of  educational  R&D  an  school  improve- 
ment. 

[Table  2  abaut  here] 

THE  STRATEGY  OF  USABLE  IGNORANCE 
A  majar  advantage  of  systematic  mediation  is  its  capacity  to  specify  and 
investigate  plausible  rival  hypotheses,  thus  contributing  to  what  Lindblom  and 
Cahen  (1979)  call  usabls  knowledge.  Yet  systematic  mediation,  at  least  in  the 
short  run,  is  mare  li.ely  ta  produce  what  Ravevz  (1987)  calls  usable  ignorance. 
Given  the  organized  complexity  a*  the  knowledge  system  of  regional  laboratories, 
it  would  be  surprising  if  systematic  mediation  did  nat  yield  conclusions  af  the 
fnr"'<i:  We  presently  do  not  know  which  approaches  to  knowledge  transfer  and 
school  improvement  ore  most  effective.  For  such  ignorance  to  be  usable,  however, 
what  is  nat  known  must  be  placed  in  a  category  which  Mertan  (1987)  appropriately 
calls  specifiable  ignorance.  As  important  as  it  is  to  know  what  is  knawn  abaut 
the  production,  transfer,  and  utilization  af  educational  R&D,  it  is  equally 
important  to 

...classify,    codify,    and    thereby    specify    what    needs    to  be  discovered, 

collected,  found,  developed  and/ar  solved  Dmitri  I.  Mendelyeev  (1889)  led 

the  way  in  this  regard.  By  reflecting  an  the  work  af  others  he  classified, 
codified,  and  thereby  unified  a  major  portion  of  chemistry  af  his  day.  But 
he  did  mare;  the  voids  in  his  Periodic  Table  specified  what  was  yet  ta  be 
faund.  Some  of  these  voids  exist  to  this  day.  Though  they  defy  discovery, 
they  are  real  voids  in  knowledge  nevertheless  (Reisman,  1989,  p.  67). 

18 


Usable  ignorance,  defined  in  this  way,  is  distinguishable  from  inadvertent 
ignorance  (i.e.,  ~.  ror)  as  well  as  deliber^ce  ignorance  (i.e.,  fraud)  in  the 
natural  sciences  and  medicine  (see,  e.g.,  Kohn,  1986)  and  *ri  the  applied  social 
sciences  (see,  e.g.,  Campbell,  1987;  also  see  Ravetz,  1971).  In  contrast  to 
inadvertent  and  deliberate  ignorance,  usable  ignorance  is  likely  to  be  adaptive 
(see  Reser  and  Smithson,  1989),  at  least  to  the  extent  that  laboratories  and 
other  institutions  within  the  educational  knowledge  system  are  freed  from 
unrealistic  and  guilt-in Jucing  obligations.  For  example,  the  obligation  to 
produce  "usable,"  "practical,"  or  "applicab:  •  knowledge  is  frequently  unattain- 
able in  real-li*e  settings  areat  complexity,  where  the  creation  of  usable 
ignorance  is  often  a  first  step  to  devising  appropriate  solutions  The  strategy 
of  usable  ignorance  can  facilitate  systematic  mediation  by  classifying,  codify- 
ing, and  specifying  whet  needs  to  be  discovered  to  make  progress  in  producing, 
transferring,  and  utilizing  educational  R&D  for  the  improvemenc  of  schools.  In 
designing  a  strategy  of  usable  ignorance  laboratories  and  their  sponsors  might 
consider  innovations  in  three  areas:  agenda  setting,  organization  design,  and 
methodology  development. 

Agenda  Setting 

Many  of  the  most  important  problems  facing  regional  laboratories  are 
problems  which  have  been  characterized  as  "messy"  (Ackoff,  1974),  "squishy" 
(Strauch, 1976),  "divergent"  (Muson,  1988),  or  "ill  structured"  (Simon,  1973; 
Mitroff,  1974).  The  {  i-oblem  of  knowledge  transfer  for  school  improvement  is  an 
ill  structured  problem  because  it  is  embedded  in  the  organized  complexity  of  the 
knowledge  system  of  education.  This  system,  ar  we  have  seen,  is  usefully  viewed 
as  a  complex  river  delta  with  tangled  and  interpenetrating  branches.  Like  other 
iU  structMre*  problems  (see  Dunn,  1988),  the  problem    of  knowledge    transfer  far 
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school  improvement  has  several  important  characteristics:  ambiguous  or  unknown 
goals;  indeterminate  or  unknown  phases  through  which  goals  may  be  achieved; 
ambiguous  or  unknown  strategies  for  achieving  goals  through  phases;  and  an 
unbounded  and  hence  unmanageably  huge  domain  of  potentially  relevant  goals, 
phases,  and  strategies. 

Under  these  conditions  it  is  essential  that  laboratories  create  usable 
ignorance  by  codifying,  classifying,  and  thereby  specifying  what  needs  to  be 
discovered  in  order  to  achieve  success  in  transferring  knowledge  for  school 
improvement.  Lieb-Brilhart  (1989),  for  example,  has  challenged  the  assumption 
that  "redundant"  information  from  multiple  sources  has  overloaded  educational 
policymakers  and  practitioners.  In  contrast  to  this  blanket  opposition  to 
redundancy,  Lieb-Brilhart  (p.  11)  specifies  what  is  not  yet  known  by  hypothesiz- 
ing that  redundancy  is  unlikely  to  be  successful  in  areas  of  information  acquisi- 
tion and  storage;  but  redundancy  may  be  appropriate  and  useful  in  areas  of 
knowledge  utilization,  synthesis,  communication,  and  implementation. 

As  these  examples  suggest,    it    is    not    precise    single    solutions    to  well 

structured  problems    that  should    dominate  the    agendas  of  regional  laboratories; 

rather  it  is  multiple  approximate    solutions    to    ill    structured    problems  which 

arise  from    the  organized  complexity  of  the  educational  knowledge  system.  Indeed, 

when  precise  single  solutions  are  advanced  as  answers  to  ill  structured  problems, 

we  are    likely  to    find  so-called  Type  III  errors:    Formulating  precise  solutions 

for  the  wrong  problems  (see  Raiffa,  1968;    Mitroff,     197^;    Dunn,     1988).        In  a 

ccr.tCAt  of    concern  with    the  agenda-setting  process  of  regional  laboratories  the 

following  recommendations  see  appropriate: 

o  Laboratories  should  be  rewarded  for  creating  usable  ignorance  through 
the  discovery  of  actionable  research  problems  in  areas  of  knowledge 
synthesis,  storage,  development,  dissemination,  and  utilization.  The 
incentive    systems    of    laboratories    should  encourage  the  discovery  of 

m 
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practically  important  problems,  along  with  strategies  which  might 
clarify  or  alleviate  these  problems,  not  the  ritualistic  counting  of 
products  developed  and  disseminated  to  various  groups  or  the  listing  of 
superficial  "needs"  or  "preferences."  An  appropriate  system  of  incen- 
tives will  maximize  ti.  likelihood  that  laboratories  strive  to  discover 
such  problems  and  place  them  on  their  own  agendas  and  those  of  the 
wider  educational  research  ana  policy-making  communities. 

o  Laboratories  should  be  rewarded  for  developing  appropriate  research 
proposals  for  investigating  problems  placed  on  research  agendas,  even 
if  no  funds  are  available  to  carry  out  the  proposed  studies.  The  best 
of  these  proposals  should  be  made  available  to  all  regional  laborator- 
ies for  th3ir  consideration  and  future  use. 

o  Laboratories  should  compete  for  awards  which  would  be  made  available  to 
those  who  havj  discovered  actionable  research  problems  and/or  developed 
appropriate  research  proposals  for  the  clarification  or  alleviation  of 
these  problems.  Results  of  quarterly  or  annual  competitions,  along 
with  the  winning  problems  and  proposals,  should  be  published  in  the 
official  newsletter  of  the  Regional  Educational  Laboratory  Program. 

By    providing    institutional    incentives    for    the    discovery    of  actionable 

research  problems,  and  the  development  of  research  proposals    which  address  these 

problems,  the  laboratory  program  would  expand  capacities  to  classify,  codify,  and 

thereby  specify  what  needs  to  be  discovered,  found,  or  solved.      Usable  ignorance 

would    be    available    at    a    time    when  usable  knowledge  is  generally  unavailable 

because  of  the  organi^ad  complexity  of  the  knowledge  system  in  which  laboratories 

function . 


Managing  Pragmatic  Validity 

The  professional  culture  of  laboratories  is  that  of  the  technical  community 
(MacRae,  1986),  which  is  responsible  for  what  may  be  called  pragmatic  (as 
distinguished  from  merely  scientific)  validity.  In  contrast  to  scientific 
communities,  technical  communities  are  guided  not  only  by  the  theoretical  and 
methodological  criteria  of  excellence  associated  with  scientific  validity,  but 
also  by  pragmatic  validity  as  it  is  manifested  in  adherence  to  criteria  of 
excellence    in    clarifying,    alleviating,    and    solving    practical    problems.  In 
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scientific    communities    with    relatively    well-cadif ied    rules    there    are  many 


reported  deviations    fram  criteria    af  theoretical    and  methodological  excellence 

(see,  e.g.,  Kahn,  1986).    But    numerous    deviations    fram    criteria    of  practical 

excellence    have    been    reported    in    technical  communities  which,  working  in  the 

applied  physical  and  social  sciences,  have  few  codified  rules  (see,  e.g.,  Snyder, 

Stevens,  and  Tarnatzky,  1983).    In  discussing  deviations  fram  scientific  validity 

in  the  applied  physical  sciences  Ravetz  argues  that: 

...the  application  af  scientific  inquiry  to  new  practical  problems  should  be 
even  mare  hazardous  than  the  management  of  deeply  navel  results  within 
science  itself.  To  the  extent  that  the  investigation  of  problems  loses  its 
protective  framework  of  accepted  and  successful  methods,  it  becomes  exposed 
ta  pitfalls  of  every  sart....an  immature  field,  in  chaos  internally, 
experiences  the  additional  strains  of  hypertrophy,  and  its  leaders  and 
practitioners  are  exposed  to  the  temptations  of  baing  accepted  as  consult- 
ants and  experts  far  the  rapid  solution  of  urgent  practical  problems.  The 
field  can  saan  became  identical  in  outward  appearance  to  an  established 
physical  technology,  but  in  reality  be  o  gigantic  confidence-game,  combining 
the  worst  features  af  entrepreneurial  and  shaddy  science.  The  dangers  af 
such  corruption  are  at  present  more  acute  for  same  of  the  social  sciences 
and  technologies  (especially  thase  using  mathematical  and  computational 
taals)  than  far  the  natural  sciences,  since  they  are  related  ta  the  mast 
urgent  practical  problems  and  they  lack  a  base  in  fully  matured  disciplines 
(Ravetz,  1971,  pp.  399-W1). 

The  wark    of  the    regional  laboratories  is  prane  ta  deviate  from  criteria  af 

scientific  and  pragmatic  validity.    The  reasons  far  such  deviation    are  rooted  in 

part    in    the    social    and    political    arrangements  which  affect  the  structuring, 

storage,  distribution,  and  utilization  a?  scientific    research.      In  the  physical 

sciences  the  achievement  of  scientif ice lly  valid  results  is 

q  product  of  the  mutually  reinforcing  (rewarding  and  disciplining)  scien- 
tific community.  The  validity  of  scientific  truth  claims  daes  not  came 
from  the  innate  or  indoctrinated  honesty  and  competence  of  a  single  scien- 
tist. It  comes,  rather,  from  competitive  replication  and  criticism,  from 
fear  af  humiliation  due  ta  failed  replication  efforts,  fram  competition  far 
discovery  and  eminence  so  organized  as  to  disclose  (rather  than  cover  up) 
error,  incompetence  and  fraud  (Campbell,  1987,  p.  3). 
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In  education  and  other  applied  social  sciences  the  achievement  of  results 
which  have  scientific  and  pragmatic  validity  is  likewise  a  product  of  the  social 
system  of  applied  science.  The  success  of  the  regional  laboratories  is  likely  to 
depend  on  the  degree  to  which  the  educational  knowledge  system  fosters  mutual 
criticism  and  self-criticism,  encourages  a  joint  commitment  to  work  on  shared 
problems,  and  generates  competition  for  rewards  set  aside  for  those  who  generate 
usable  ignorance  by  codifying,  classifying,  and  specifying  what  needs  to  be 
discovered,  developed,  and/or  solved  to  effectively  transfer  knowledge  for  school 
improvement.  In  this  context,  several  recommendations  are  worthy  of  considera- 
tion : 


o  Laboratories  should  be  rewarded  for  conducting  research  and  practice 
syntheses,  as  well  as  standard  meta-analyses,  which  expose  significant 
sources  of  error  and  bias  in  the  conclusions  and  recommendations  of 
educational  researchers  and  practitioners.  These  syntheses  and  meta- 
analyses promote  mutual  criticism  and  self-criticism  within  a  framevork 
of  commonly  accepted  standards,  fostering  the  discovery  of  usaole 
ignorance. 

o  Laboratories  should  be  rewarded  for  replicating,  cross-validating,  and 
evaluating  promising  synthesis,  development,  and  dissemination  strate- 
gies attempted  elsewhere.  Replication,  cross-validation,  and  evaluation 
facilitate  the  search  for  usable  ignorance. 

o  The  unit  of  r  luation  and  object  of  incentives  (rewards  and  disci- 
pline) shoulc  je  the  synthesis,  development,  and  dissemination  strate- 
gy, not  the  laboratory,  the  laboratory  program,  or  the  laboratory 
staff.  The  evaluation  of  strategies,  by  focusing  on  specific  mechan- 
isms for  enabling  practice  irrcrovements,  depersonalizes  rewards  and 
discipline,  minimizes  deviance  from  accepted  professional  standards 
for  reasons  of  self-preservation,  and  enhances  awareness  that  failures 
are  not  personal  but  stem  from  the  organized  complexity  of  the  knowl- 
edge system. 

By  developing  an  incentive  system  which  encourages  the  effective  management  of 
pragmatic  validity,  laboratories  should  have  greater  capacity  to  realize  stand- 
ards of  excellence  appropriate  for  a  technical  community. 
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Methodology  Development 

Regional  loboratories  need  methods  oppropriote  for  investigating  ond  shoping 
the  orgonized  complexity  of  the  educotionol  knowledge  system.  By  now  it  is  cleor 
thot  most  methods  ovoiloble  to  loborotories,  ond  to  the  sociol  science  reseorch 
community  os  o  whole,  ore  incompatible  with  problems  which  have  exceeded  o  given 
level  of  complexity  (Brewer  and  de  Leor  1983,  p.  125;  also  see  Dunn,  1988). 
This  principle  of  incompatibility  is  particularly  relevont  to  problems  of 
ossessing  the  impoct  of  loborotories  which  function  in  o  knowledge  system 
characterize  by  organized  complexity,  in  this  context  severol  recomnendotions 
oppeor  worthy  of  consideration: 


o  Loborotories  should  develop  common  evoluotion  methodologies  which  ore 
systemic  in  noture.  In  controst  to  beon-countine  procedures  motivoted 
by  on  understondoble  desire  for  self -preservation,  systemic  methodolo- 
gies would  focus  on  the  interrelationships  ond  interdependencies  among 
the  ronge  of  knowledge  functions  performed  by  loborotories.  For 
exomple,  the  mediating  functions  performed  by  loborotories  mc/  be 
represented  os  o  motrix  or  network  which  disploys  spatiol  ond  temporol 
linkoges  between  key  knowledge  functions:  mondoting,  production, 
structuring,  storoge,  distribution,  utilization. 

o  Loborotories  should  obondon  whot  may  be  colled  "terminol"  impoct 
indicotors,  insteod  developing  "enobling"  impoct  indicators.  Enobling 
impact  indicotors  would  meosure  and  ossess  the  extent  to  which  o  given 
function — for  exomple,  the  structuring  of  knowledge  by  means  of 
reseorch  ond  proctice  syntheses — enobles  the  successful  performance  of 
onother  function  such  os  the  development  of  multiple  products  (product 
dif f erentiotion )  torgeted  ot  different  groups  of  policymokers  ond 
proctitioners. 

o  Loborotories  should  build  on  post  NIE-sponsort>d  reseorch  on  the 
conceptuoiizotion  ond  meosurement  of  knowledge  utilizotion  by  develop- 
ing new  profiles,  inventory :,  roting  scoles,  ond  indexes  which 
copture  the  complexity  of  the  process  of  utilizing  knowledge.  It  is 
widely  occepted  thot  knowledge  is  rorely  used  instrumentolly,  for 
exomple,  to  make  o  policy  decision.  Insteod,  knowledge  is  most  often 
used  conceptuolly,  for  excnple,  in  cases  where  new  reseorch  on  teoching 
ond  looming  is  used  by  principols  ond  teochers  to  develop  new  "working 
vocabulories"  which  olter  the  way  they  think  obout  problems  of  school 
improvement  ond  their  potentiol  solutions. 
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The  methodological  recommendatior.s  presented  above  are  responsive  to  the  con- 
straints and  opportunities  facing  regional  laboratories  os  key  institutions 
within  the  knowledge  system  of  education.  These  recommendations  are  closely 
related  to  knowledge  systems  accounting  (Dunn  and  Holzner,  1987),  an  approach  and 
methodology  which  draws  on  prior  efforts,  first  in  the  1930s  and  then  in  the 
1960s,  to  developing  national  economic  accounting  and  social  systems  accounting. 
Social  systems  accounting,  established  in  an  era  of  large-scale  public  interven- 
tion to  alleviate  pressing  social  problems  (The  Great  Society),  yielded  indica- 
tors suitable  for  evaluating  social  policies  and  programs.  Knowledge  systems 
accounting,  evolving  in  an  era  of  large-scale  public  investments  in  science  and 
technology  (The  Post-Industrial  or  Knowledge  Society),  is  a  systemic  methodology 
which  is  appropriate  for  monitoring  and  evaluating  impacts  of  thw  interpenetrat- 
ing and  tangled  functions  which,  performed  by  laboratories  and  other  mediating 
institutions,  create  the  organized  complexity  of  the  knowledge  system  of  educa- 
tion . 

CONCLUSION 

The  organized  complexity  of  the  educational  knowledge  system,  formed  by  the 
interpenetration  of  tangled  knowledge  functions  which  appear  as  a  river  delta, 
raises  doubts  about  the  appropriateness  of  school  improvement  as  a  standard  of 
accountability.  The  stunning  decline  of  federal  funds  available  to  laboratories 
reinforces  such  doubt,  since  weak  interventions  in  the  knowledge  system  of 
education  are  unlikely  to  have  large  or  even  discernible  impacts  upon  the 
improvement  of  schools.  The  paucity  of  resources  available  to  laboratories  has 
been  partly  responsible  for  an  indirect  service  strategy  where  laboratories 
operate  as  "information  utilities, "  performing  mediating  functions  in  a  manner 
characterized  as  "random  mediation. n    Random  mediation  may    be  gradually .replaced 

25 


with  "systematic  mediation"  by  conducting  quasi-experimental  field  studies 
directed  toward  the  classification,  codification,  and  specification  of  what  needs 
to  be  discovered  to  effectively  transfer  knowledge  to  those  in  need.  This 
strategy  of  usable  ignorance,  supplemented  by  recommendations  in  areas  of  agenda 
setting,  managing  pragmatic  validity,  and  methodology  development,  is  a  way  to 
deal  with  the  organized  complexity  of  the  knowledge  system  of  education. 
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Table  1 

FEDERAL  R&D  EXPENDITURES  BY  FUNCTION,  1973-1988 
(constant  1972  dollars)1 

Change 

Function  75      75      80      85       86       87       88      75-88  80-88 

MILITARY  R&D  $8.6  $8.1  $8.4  $12.5  $13.4  $14.5  $16.2  88.5*  92.8* 
($billions) 

CIVILIAN  R&D  7.7    7.3    8.4      6.8      6.7      6.7      6.4  -16.8  -25.8 
($billions) 

NIE/OERI  98.8  47.6  41.9    21.8    20.5    21.6    20.6  -79.1  -50.8 
($millions) 

LABORATORIES2  22.0  15.6    9.9      6.1      7.0      6.7      6.5  -70.5  -54.5 
($millions) 


SOURCES:  National  Science  Board,  Science  and  Engineering  Indi- 
cators— 1987    (Washington,    D.C. :    National    Science  Foundation, 

1987)  ;  National  Science  Board,  Science  Indicators:  The  1985 
Report  (Washington,  D.C. :  National  Science  Foundation,  1985);  and 
"Brief  History  of  Regional  Educational  Laboratories  and  Research 
and  Development  Centers"  (Washington,  D.C. :  U.S.  Department  of 
Education,  Office    of  Educational  Research  and  Improvement,  March 

1988)  . 

1  Constant  1972  dollars  calculated  from  6NP  price  deflators 
supplied  by  the  U.S.  Department  of  Commerce. 

2  Figures  for  FY1987  and  FY1988  exclude  funds  for  the  Rural 
Initiative. 
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Table  2 

SOURCES  AND  FORMS  OF  ERROR  IN  ASSESSING  THE  IMPACT 
OF  REGIONAL  LABORATORIES  ON  SCHOOL  IMPROVEMENT 

Source  Rival  Hypothesis 


AMBIGUOUS  Dimensionality  Bias.  A  single  dimension  of  R&D  utilization 

ASSESSMENT  (e.g.,  decisional    use)  is    confounded  with  another  dimension 

CRITERIA  (e.g.,  conceptual  use),    making    assessments    of    the  labora- 

tory's impact  equivocal. 

Source  Bias.  A  particular  source  of  knowledge  (e.g.,  casual 
empiricism)  is  confounded  with  another  (e.g.,  science), 
making  assessments  of  the  source  of  a  laboratory's  impact 
equivocal. 

STRATEGIC  Strategy  in  Use.    The  strategy  actually  used  by  a  laboratory 

INFIDELITY  (e.g.,  political  bargaining)  is  confounded  with    its  publicly 

espoused  strategy  (e.g.,  networking  or  environmental  scann- 
ing), making  assessments  of  the  reasons  for  a  laboratory's 
impact  equivocal. 

Multiple  Strategy  Interference.  Multiple  strategies  of 
development  or  dissemination  are  curried  out  simultaneously 
(e.g.,  mass  mailing  and  targetea  mailings  of  products), 
making  assessments  of  the  reasons  for  a  laboratory's  impact 
equivocal . 

Strategy  Non-Peplicability.  A  laboratory  strategy  is  so  vague 
or  general  (e.g.,  "social  interaction ")  that  it  cannot  be 
repeated  twice,  or  in  more  than  one  context,  making  assess- 
ments of  the  reasons  for  the  laboratory's  impact  equivocal. 

MATERIALS  Seguence.  The  sequence  of  presenting  ideas    or  conclusions  in 

BIAS  a  laboratory  document  (e.g.,  using  the  ••'pyramid"  principle  in 

news  releases)  is  confounded  with  the  content  of  the  document 
and  the  strategy  of  dissemination,  making  assessments  of  the 
reasons  for  a  laboratory's  impact  equivocal. 

Format.  The  format  for  presenting  ideas  or  conclusions  (e.g., 
case-wise  rather  than  variable-wise  displays)  is  confounded 
with  the  content  of  the  document  and  the  strategy  of  dissem- 
ination, making  assessments  of  the  reasons  for  a  laboratory's 
impact  equivocal. 

Translation.  The  process  of  translating  conclusions  from 
technical  into  non-technical  language,  or  from  descriptions 
into  prescriptions,  creates  departures  from  original 
research-based  findings  ana  a  loss  of  information,  making 
assessments  of  the  reasons  for  a  laboratory's  impact  equivo- 
cal. 
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INCONGRUENCE 


Toble  2 
(continued) 

Multiple  Interpretation  Interference.  The  subjective  inter- 
pretations of  R&D  by  laboratory  personnel  arid  intended  users 
are  sufficiently  different  that  the  impact  of  R&D  cannot  be 
separated  from  the  impact  of  its  interpretation,  making 
assessments  of  the  reasons  for  a  laboratory's  impact  equivo- 
cal. 


CONTEXTUAL 
VARIATIONS 


Latent  Function.  The  latent  functions  of  research,  develop- 
ment, dissemination,  and  utilization — for  example,  political 
control,  program  subversion,  symbolic  legitimation,  ritual- 
istic compliance — are  confounded  with  manifest  functions  such 
as  school  improvement,  making  assessments  of  the  reasons  for 
a  laboratory's  impact  equivocal. 

Structure.  The  spatial  and  temporal  pattern  of  knowledge 
functions  performed  by  a  laboratory — for  example,  serial, 
parallel,  assembly,  arborescent,  cyclic — is  confounded  with  a 
development  or  dissemination  strategy,  making  assessments  of 
the  reasons  for  a  laboratory's  impact  equivocal. 

Maturation.  Processes  of  learning  occurring  within  users  of 
laboratory  products  are  confounded  with  the  effects  of 
dissemination  strategies,  making  assessments  of  the  reasons 
for  a  laboratory's  impact  equivocal. 

History.  Events  other  than  a  development  or  dissemination 
strategy  (e.g. ,  an  election  or  teacher  strike)  produce 
effects  which  are  confounded  with  the  effects  of  the  strate- 
gy, making  assessments  of  the  reasons  for  a  laboratory's 
impact  equivocal. 

Solution-Regression.  Pressures  for  solutions  tend  to  occur 
when  problems  are  most  severe  ("The  problem  must  get  worse 
before  it  gets  better. "),  creating  a  regression  towards 
normality  which  is  independent  of  the  effects  of  a  strategy, 
thus  making  assessments  of  the  reasons  for  a  laboratory's 
impact  equivocal. 


SOURCE:    Adapted  from  Dunn  (1986),  Table  1,  pp.  205-206. 
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CHAPTER  I 
INTRODUCTION 
Background 

In  1984-85,  the  U.  S.  Department  of  Education  funded  nine 
regional  educati  onal  laboratories  to  provide  R&D  services  to  every 
area  of  the  United  States,  including  Puerto  Rico,  the  U.  S.  Virgin 
Islands,  and  U.  S.  Pacific  Territories.  This  decision  represented 
a  new  beginning  for  a  program  that  had  been  through  19  turbulent 
and  controversial  years.  During  that  period  the  program  had  seen 
major  shifts  in  purposes,  government  support,  and  relationship  of 
the  laboratories  to  other  educational  organizations.  Of  20 
laboratories  funded  in  1965-66,  only  seven  remained.  Frequent 
changes  in  regional  boundaries  had  been  made,  but  large  areas  of 
the  country  had  no  laboratory  to  serve  them. 

In  1983  the  National  Institute  of  Education  (NIE),  then  the 
Federal  uni  t  responsibl e  for  the  program  ,  decided  to  continue  but 
redesign  the  program  and  recompete  the  contracts.  To  address  the 
problems  previously  identified  (Chase,  1968;  Campbell,  et  al ,  1975; 
Panel,  1979);  and  put  the  program  on  a  firmer  footing,  NIE 
undertook  a  massive  participatory  planning  effort.  Redrawn 
boundaries  identified  10  regions.  (Two  regions,  the  Northwest  and 
the  Pacific  Territories,  were  combined  for  the  first  five-year 
period.)  To  ensure  meaningful  competition  in  each  region,  up  to 
three  groups  in  each  region  were  awarded  planning  grants  prior  to 
the  laboratory  competition . 
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The  request  for  proposal  (RFP)  that  emerged  from  the  planning 
process  represented  a  carefully  thought-out  Federal  strategy  for 
supporting  educational  Improvement.  Nine  labs  funded  as  a  result 
of  that  competition  !iave  now  bee*  1n  operation  for  two  years.  The 
present  repprt  represents  one  component  of  a  broader  program 
evaluation  plan  Intended  to  help  policymakers  and  program 
stake-hol ders  understand  how  the  new  program  1s  faring  (OERI  1987). 
This  study  provides  a  descriptive  synthesis  of  documents  and 
reports  produced  by  the  laboratories  themselves.  It  will  be 
complemented  by  field  studies  and  policy  analyses  to  be  undertaken 
during  1987-89.  These  program  evaluation  activities  have  been 
supplemented  by  sel f -assessment  efforts  required  of  the  labs  and  a 
performance  evaluation  by  external  peer  review  teams  at  the  end  of 
the  first  two  years. 


Purposes.  Met hods,  and  Limitations , 

This  study  looks  across  the  nine  laboratories  and  attempts  to 
get  a  clearer  picture  of  how  laboratories  view  their  mission  and 
strategy,  activities  undertaken,  and  relationships  established. 
What  are  their  similarities  and  differences?  The  intent  1s 
descriptive  rather  than  evaluative,  even  though  this  project  is 
part  of  an  evaluation  plan.  Perhaps  it  will  also  make  a  modest 
cont  r ibutlon  to  the  emergent  research  field  of  knowl edge 
applications,  for  which  a  journal,  Knowledge  in  Society,  has  just 
been  established   (Dunn  and  Holzner  1988). 

The  RFP  for  the  lab  competition     laid  out  a  broad  framework  for 
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lab  operations  but  did  not  attempt  a  detal led  specification  of 
activities.  Indeed,  it  required  that  each  lab  program  should 
result  from  a  careful  process  of  Interaction  with  a  wide  variety  of 
organizations  and  stakeholders  1n  the  region  to  establish  needs, 
resources,   and  opportunities  peculiar  to  each  region. 

This  study  has  two  major  fod  of  Interest:  (1)  results  of  the 
process  whereby  the  labs  negotiated  their  role  in  the  region, 
Identified  regional  needs,  and  established  their  program,;  and  (2) 
strategl as  chosen  to  Implement  that  role . 

The  database  for  the  analysis  is  limited  to  documents  prepared 
by  the  labs  themselves,  notably  planning,  needs  sensing, 
self-assessment ,  and  annual  reports.  This  places  some  limitations 
on  the  Interpretation.  There  1s,  of  course,  a  human  tendency  to 
"place  one's  best  foot,  forward1*  when  a  contractor  prepares  reports 
for  Its  funding  agency,  especially  considering  the  nistory  of 
conflict  between  the  continuing  labs  and  prior  funding  agencies 
(NIE  and  the  Office  of  Education).  Furthermore,  there  is  "nany  a 
slip  twlxt"   plan  and  Implementation. 

However,  there  1s  also  an  upside  to  this  situation.  According 
to  alternative  views  of  the  planning  process,  planning  is  a 
"sense-making"  activity  that  more  often  provides  an  understanding 
of  what  has  been  already  done  than  what  1s  to  come  (Clark  1980). 
Perhaps  the  same  can  be  said  cr  progress  reports.  They  may  be 
rationalizations  1n  the  bad  sense,  but  they  also  may  be  1n  the  good 
sense-making  meaning.  Further,  because  we  are  dealing  with 
professionals  for  whom     the  norms  of  science  have     some  meaning,  in 
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overly  cynical  view  does  not  seem  warranted.  If  we  understand  what 
kinds  of  documents  we  are  dealing  with,  these  documents  should 
contain  useful  information. 

More  specif 1ca 11 y ,   core  documents  anal y zed  for  each   lab  were : 
o  Five-year  pi  an  for  1986-90* 

o  Governance  and  organizational   status  report 

o  Plan  for  FY  1988-90 

o  Annual   reports  for   1986  and  1987 

o  Needs  sensing  report  for  1986 

o  Self-assessment  reports  for  1986  and  1987 

The  time  reference  of  the  present  report  will  vary  somewhat 
from  section  to  section.  Clearly  the  above  reports  have  varying 
time  references.  The  major  focus  will  be  on  the  status  of  the 
program  at  the  end  of  the  second  contract  year,  i.e.  November  30, 
1987.  What  1s  the  status  of  the  program  at  that  point  in  time? 
However,  these  are _  dynamic  organizations,  and  we  also  are 
Interested  in  how  they  got  where  they  are.  Some  reference  to 
changes  made  prior  to  this  point  in  time  will  be  introduced  where 
appropriate  Information  1s  available.  Although  the  plans  for  years 
three  through  five  were  originally  excluded  from  the  scope  of  this 
study,  they  represent  the  culmination  of  the  complex  needs  sensing , 
sel f -assessment ,  and  pi anning  process  of  years  one  and  two  and  were 
found  to  be  a  rich  source  of  Information  on  lab  status  and  thinking 
as  the  end  of  their  first  two  years  approached. 

Studying     nine     labs  1s     a     form     of  multlsite  qualitative 
policy     research  (Herriott     and     Firestone,      1983).     Our  principal 

*A11  years  in  this  report  refer  to  contract  years. 
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method  1s  to  develop  typologies  both  Inductively  and  deductively  to 
explore  the  similarities  and  differences  among  these  nine  cases. 
The  principal  points  of  referenca  are  the  framework*  provided  by  the 
lab     RFP  and     the     research  questions     posed  in     the     RFP  for  this 


that  suggest  a  fit  between  certain  strategies  and  tactics  on  the 
one  hand  and  regional  needs  and  opportunities  on  the  other . 

A  leitmotif  1n  the  analysis  will   be  a  concern  with  how  the  labs 


such  as  arithmetic  problems,  divergent  problems  have  no  specific 
solution;  one  can  only  develop  a  modus  operandi  for  ccping 
(Schumacher,  1973).  Some  of  the  principal  divergent  problems  faced 
by  the  labs  Include: 


o  Accountability  vs.  flexibility 
o  Independence  vs .  dependence 
o  Prime  mover  vs.  catalyst 

o  Need     to       show     Impact     at     the       school     level  and 

restriction  to  Indirect  strategy, 
o  Proactive  vs.   reactive  posture 


In  may  respects  this  an  Insider's  report.  It  was  commissioned 
by  OERI  as  part  of  a  more  comprehensive  evaluation  plan  (OERI 
1987).  Its  primary  audiences  are  OERI  personnel,  the  Laboratory 
Review  Panel,  lab  personnel,  and  those  more  generally  interested  1n 
Institutional  arrangements  for  educational  Improvement .  Acronyms 
have  been  used  liberally  to  avoid  cumbersome  language  and  should  be 
familiar  to  most  members  of  these  audiences.  For  those  who  may 
need  to  refresh  their  memories,  a  glossary  of  acronyms  and 
abbrevlat 1ons  has  been  provided  as  Appendix  C . 


project .     We     are  part icul ar 1 y     Interested  in     di scover ing  patterns 


cope  with  divergent  problems. 


In  contrast  to  convergent  problems , 
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The  Laboratory  Mission 

Laboratories  can  be  viewed  as  an  Instrument  1n  a  Federal  macro- 
stratogy  for  knowledge-based  educational  Improvement.  At  the  time 
they  were  conceived  1n  the  1960?s  the  Federal  Government  had  been 
supporting  a  small  program  of  research  grants,  primarily  to 
universities,  for  about  ten  years.  The  un 1 vers  * ty-based  R&D 
Centers  and  the  Educational  Resource  Inf or mat  1  on  Center  (ERIC)  had 
been  started  just  the  year  before  and  were  the  only  other  Federal 
Initiatives  designed  to  use  new  organizational  entitles  for 
bridging  the  gap  between  research  and  practice.  Since  that  time, 
the  number  of  Federal  programs  that  support  "assistance 
Institutions"  has  grown  (Laboratory  Review  Panel  1987).  In 
addition,  state-supported  entitles  like  Intermediate  service 
agencies  have  waxed  aipd  waned.  In  designing  the  new  laboratory 
competition,  1t  was  necessary  to  take  these  changes  in  the 
Infrastructure  Into  account. 

The  Federal  perspective  on  the  mission  of  the  laboratories  is 
discussed  in  some  detail  in  the  RFP  and  sumnarized  1n  six 
"statements"  and  the  five-task  structure  (Appendix  A) .  Analysis 
suggests  that  these  can  be  grouped  and  summarized  as  three  major 
st rategies  and  two  sub-st rategies : 

THE  LINKAGE  STRATEGY 

A.     Regional  sub-strategy 

o  Laboratories  serve  designated  regions   (Statement  4) 
o  Laboratories  have  Independent  governing  boards 
(Statement  5)  and  develop  effective  governance, 
management,   planning,   and  evaluation  systems 
(Task  1). 

o  Laboratories  work  with  and  through  existing 

organ  izat 1 on s     to     improve  school s     and     cl ass  rooms 
(Task  2). 
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o  Laboratories  work  with  state- level  decisionmakers 
on  school   Improvement  Issues  (Task  3). 
B.  Nat lonal  sub-strategy 

o  Laboratories  are  part  of  a  nationwide  system 
(Statement  6) . 

o  Laboratories  work  1n  collaboration  with  centers 

and  with  other  laboratories  on  regional  and 
nat 1ona 1  educational   pr obi  ems   (Task  5 ) . 

THE  IMPROVEMENT  STRATEGY 

o  Laboratories  focus  on  school   and  classroom 
Improvement  (Statement   1 ) . 


o  Laboratories  work  to  create  research  and  devel op- 
men  t-based  resources  for  school  Improvement  (Task 
4);  laboratories  engage  1n  applied  research  and 
development  that  support  Improvement   (Statement  3) . 

o  Laboratories  feature  dissemination  and  assistance 
strategies  (Statement  2 ) . 


\kE  SUBSTANTIVE  NEED  OR  ISSUE  STRATEGY  (EDUCATIONAL  FOCUS) 
o  Laboratories  assess  regional  needs,  capabilities 
and  opportunities  and  establish  priorities  for 
laboratory  activity  (Subtask  1:2). 

Each  of  these  tasks  and     statements  1s  discussed  1n  some  detail 

in  the  RFP     and  1n  sta.ff  papers  tnat  were     prepared  before  drafting 


The  nine  laboratory  plans  rep. esent  nine  Implementations  of  th1 
set  of  macro-strategies.  This  study  can  be  viewed  largely  as  a 
description  of  similarities  and  differences  in  ways  the  nine  labs 
have  implemented  the  Federal   concept   in  nine  regional  contexts. 

The  laboratory  concept  can  be  summarized  graphically  as  a 
three-sided  cube  (see  Figure  1).  Each  of  these  strategies  can,  1n 
turn,  be  broken  into  a  number  of  levels  or  tactics.  Every  lab 
program  has  these  three  facets;  variation  occurs  1n  the  approaches 
used  to  Implement  each.  A  number  of  typologies  and  classifications 
(summarized  1n  Chapter  VI)  are  introduced  1n  order  to  gain  an 
understanding     of  the     similarities  and     differences  among     labs  in 


the  RFP. 
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or  Issue 


Educational 


Focus,  Need 


Linkage 


Strategy 


Improvement  St ra tegy 
Figure  1.     Thro©  Dimensions  of  the  Laboratory  Mission 

their  approaches  to  these  three  strategies.  This  basic  schema  will 
be  used  throughout  the  report  to  describe  lab  activities. 


The  report  is  organized  more  or  less  in  terms  of  the  task 
structure  set  forth  in  the  RFP.  A  chapter  on  governance  and 
organization  of  laboratories  deals  with  approaches  used  to 
establish  each  lab  and  to  negotiate  its  niche  in  the  region's 
organizational  infrastructure.  A  chapter  on  planning  covers  the 
extensive  system  of  needs  sensing ,  capabi 1 ity  assessment , 
self-assessment,  and  priority  setting  required  under  Task  1  and 
represents  the  labs'  approach  to  selecting  and  designing  program 
activities.       We     then  examine     the     actual     projects  and  programs 


Organization  of  the  Report 
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undertaken  for  Task  3,  examining  in  nore  detail  the  needs 
addressed,  the  organizational  linkages  established,  and  improvement 
strategies  used-  Tasks  2  and  4  are  then  examined  together  because 
the  programs  designed  under  both  tasks  were  found  to  have  both 
linkage  and  improvement  dimensions.  Task  5,  which  was  largely  in  a 
planning  mode  during  the  period  under  review,  will  be  dealt  with 
only  where  Task  5  themes  intersect  with  work  under  Tasks  2-4. 
Finally,  some  conclusions  regarding  the  status  of  the  program  at 
the  end  of  two  years  and  some  personal  observations  will  complete 
the  report. 
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CHAPTER  II 


GOVERNANCE  AND  ORGANIZATION  OF  LABORATORIES 


Organizational  Context 


Description  of  the  Educational  Infrastructure 

In  considering  the  role  of  labs  1t  is  necessary  to  ask  where 
they  fit  in  the  overall  structure  of  education.  Herriott  (1980) 
has  provided  a  useful  distinction  among  three  kinds  of 
organizations: 


o  Service  Delivery  Organizations  (SDOs)  concerned 
primarily  with  the  direct  instruction  of  pupils  or 
wi  th  effective  management  of  that  instruct 1on . 

o  Knowledge  Producing  Organizations  (KPOs)  concerned 
primarily  with  the  conduct  of  basic  or  applied  research 
on  topics  of  potential  relevance  to  the  subfleld  of 
service  delivery 

o  Service  Improvement  Organizations  (SIOs)  concerned 
primarily  with  Unking  the  other  two  subflelds. 


The  service  delivery  field  1s  a  complex  hierarchical  system 
operating  at  five  levels:  classroom,  school,  local  education  agency 
(LEA),  intermediate  service  agency  (ISA)  -  1n  some  Instances  -  and 
state  education  agency  (SEA).  The  107,200  public  and  private 
elementary  and  secondary  schools  in  1980  give  some  sense  of  the 
large  numbers  Involved   (NCES,  1982). 

Several  attempts  have  been  made  to  describe  the  organizational 
arrangements  for  knowledge-based  educational  improvement  (Office  of 
Education  1969;  NIE  1976;  Frankel ,  Sharp,  and  Blderman  1979).  The 
19  79  study,  which  covers  both  KPOs  and  SIOs,  Identified  the 
foil  owing  numbers  of  organizations  with  some  kind  of  RDD&E 
capabl 1 i  ty : 
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37  State  Education  Agencies 

193  Intermediate  Service  Agencies 

40  *  Local   Educati on  Agencies 

423  Colleges  and  Universities 

476  Mi  seel laneous  Organizations 

Al lowing  for  multiple  R&D  units  within  organizations  (e.g., 
multiple  centers  within  a  university),  2,420  R&D  entities  existed 
within  these   1,530  organizations. 

The  dominant  image  is  one  of  large  size  and  extreme  complexity. 
Most  of  the  2,434  performers  did  not  specialize  in  this  field. 
There  was  a  high  degree  of  concentration,  with  the  172  largest 
performers  (7  percent)  accounting  for  68  percent  of  all 
expenditures.  Furthermore,  47  percent  of  the  organizations  were 
found  in  seven  states.  These  national  data  are  somewhat  out  of 
date  and  do  not  reflect  the  considerable  attrition  that  has  taken 
place  during  the  '80.  Individual  laboratories  are  charged  with 
maintaining  current  data  of  this  type  for  their  regions  (to  be 
discussed  below),  but  no  attempt  has  been  made  to  standardize  data 
collection  or  compile  national  aggregates. 

Knowl edge  production  takes  pi ac?  in  many  varied  organ i za t ional 
settings.  In  universities  it  occurs  at  three  levels :  the 
individual  project,  small  institutes  of  several  projects  and 
professors,  and  major  research  centers,  such  as  those  funded  by 
OERI,  with  multiple  programs.  Other  settings  include  profit  and 
not-for-profit  independent  firms  and  -esearch  and  evaluation  unics 
of  LEAs  and  SEAs. 

Organizations  attempting  to  assist  SDOs  with  knowledge-based 
improvement  strategies     include  many     of  the  same     organizations  as 
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well  as  school   development  councils,   the  National    Diffusion  Network 
(NDN)       and     ISAs,       teacher       centers,     and,       more     recently,  a 
proliferation     of       ad     hoc     Federally     sponsored       units     such  as 
desegregation  technical   assistance  centers . 
System  or  Configuration? 

Taken  together,  these  organizational  sectors  are  often  referred 
to  as  the  "educational  R&D  System11  or"  knowledge  production  and 
utilization  (KPU)  system".  The  legislation  that  created  NIE 
declared  as  the  policy  of  the  United  States  to  "build  an  effective 
educational  research  and  develonment  system"  (Public  Law  92-318, 
section  405,  June  23,  1972).  Yet,  according  to  some  observers, 
this  set  of  organizations,  SDOs ,  KPOs ,  and  SIOs,  does  not  meet  even 
the  minimum  requirements  of  a  system  (Sieber  1975;  Spivak  and 
Radnor  1979).  For  example,  there  is  little  functional 
specialization  among  performers  and  little  balance  among  functions, 
performers,   settings,  and  supply  and  demand. 

Coming  to  the  same  conclusion,  Clark  and  his  colleagues  decided 

that     continued     dependence     on     the     terminology     of     systems  was 

dysfunctional   and     new  frameworks     snd  met a  phor s  were     necessary  to 

understand  knowledge-based  school   improvement  (Guba  and  Clark  1974; 

Clark  and  Carroll      1980a  and   1980b;   Clark  1980;     Clark   1984).  They 

note  that  KPU  is: 

...highly  decentralized,  consisting  of  a  number  of  more 
or  less  independent  and  co-equal  members,  who  may  from 
time  to  time  find  it  helpful  to  form  temporary  alliances 
but  who,  in  the  main,  retain  their  independence,  shun 
authority  and  activity  relationships,  and  engage  in  as 
many  different  kinds  of  KPU  activities  as  seem  to  be 
needed  and  feasible  for  them  to  maintain  their 
self-sufficiency.     (Guba  and  Clark  1974,  45) 
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This  view  of  reality  is  termed  the  "  conf  -.gura  t  i  ona  1 
perspective"  and  is  analogous  to  the  concept  of  a  community  (Guba 
and  Clark,  1974).  Such  order  and  regularity  as  are  found  are  the 
result  of  negotiation  and  persuasion. 

While  this  description  may  be  somewhat  overstated,  it  appears 
closer  to  reality  than  the  systems  view.  Except  for  the  planning 
and  evaluation  functions,  it  also  appears  to  be  the  perspective  of 
those  who  planned  the  laboratory  recompeti tion . 


The  Regional   Focus  of  Laboratories 
Overview  of  Regionalism  1n  Education 

When  the  laboratories  were  first  conceived,  two  conflicting 
schools  of  thought  emerged  on  how  they  should  be  organized  and 
governed.  One  was  that  there  should  be  a  small  number  of  elite 
institutions  in  intellectual  centers,  the  other  there  should  be  a 
relatively  large  number  of  such  institutions,  organized  regionally, 
and  blanketing  the  country.  For  reasons  that  have  never  been 
entirely  clear  (but  probably  are  related  to  the  inherent  political 
appeal  of  a  program  serving  every  congressional  district),  the 
regional  approach  was  adopted,  and  the  laboratories  have  been 
regional   ever  since . 

Regional  organizations,  however,  have  no  direct  constitutional 
basis .  Regional  educational  1 aboratories  may  have  a  contractual 
relationship  to  the  Federal  government,  but  they  stand  completely 
outside  of  the  state/local  structure  of  education.  In  this  sense, 
labs  are  marginal  entities. 
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In     a     review    of       regional 1sm     1n     education,     Hof ler  (1979) 

concludes  that  there  are  several   bases  for  regionalism  : 

o  Regions  can  be  viewed  as  aggregate  composites  of  "local 
elements."  This  Implies  that  the  regional  entity  will 
be  largely  controlled  by  the  perspectives.  Interests, 
values,  goals,  etc.  of  the  constituent  elements. 

o  Heterogeneity  may  be  as  Important  as  homogeneity,  for 
1t  provides  the  possibility  of  complementarity  among 
diverse  resources . 

o  Regions  may  be  based  on  cultures  of  collaboration: 
attitudes  and  values  that  Imply  an  openness  to  the 
possibility  of  working  together. 


The  form,  focus,  or  scope  of  regionalism  also  tends  to  be 
highly  time-dependent,  being  either  short-  or  long-term,  and 
varying  over  time. 

> 

Hof ler  concluded  that,  as  "In-between  organizations,"  regional 
organizations  have  a  particular  opportunity  to  provide  both 
local-national  mediation  and  opportunities  for  cross-state/local 
linkages.  Further,  they  are  less  vulnerable  to  pendulum  swings 
between  centralization  and  decentralization. 

Hofler  presents  four  arguments  1n  favor  of  and  four  against 
organizing  on  a  regional  basis. 


The  case  FOR  regional  organization: 

o  Regional  approaches  can     serve  a  variety  of  (although 
not  all)  educational   KPU  purposes . 

o  Regionalism     1s  Inherently  suited     for  local/national 
mediation  and  for  cross-state/local  linkages. 

o  Regionalism     seems  to  be  a     political   requirement  for 
continued  congressional  support . 
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o  "T.nere  1s  reasonably  strong  evidence  to  suggest  that 
contextual  forces  do  at  times  converge  to  provide  a 
basis  for  successful   uses  of  regionalismM    (p.  14). 

The  case  AGAINST  regional  organ  izatl on : 

o  Regionalism  seems  to  have  no  preemptive  strengths. 
Valid  national  and/or  local  alternatives  are 
generally  also  available. 

o  Successful       regionalism  highly  context-specific 

and     tends     not  to     be     general izabl e     in  a  planned, 
orderly  manner" . 

o  While  regionalism  1s  relevant  to  coordination  it  is 
not  a  panacea  for  coordination  problems.  Other 
non-regional  alternatives  are  available  for 
coordination,  and  regionalism  in  fact  adds  to  the 
amount  of  coordination  requ i red . 

o.  Both  governmental  and  educational  contexts  present 
formidable  constraints  against  regionalism. 

* 

Observations  of  the  regional  educational  laboratories  suggest 
•  several  pragmatic  considerations.  The  prime  responsibility  for 
education  rests  with  over  50  state-level  education  agencies  and 
15,600  local  districts.  For  the  most  part  education  agencies  tend 
to  be  inwardly  focused.  When  they  look  outward  toward  the  nation 
as  a  whole,  they  are  swamped  by  the  numbers  involved.  Working 
together  within  regions  makes  the  numbers  manageable  and  still 
makes  it  possible  for  each  agency  to  compare  itself  with  others 
having  similar  problems.  In  addition,  travel  and  other 
efficiencies  are  1nvol ved . 

At  another  turning  point  1n  lab  history,  the  NWREL  rs-examlned 
the  concept  of  regionalism  and  concluded  that  Its  own  regional 
definition  was  justified  with  reference  to: 
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o  Geography  (including  topography,  population  patterns, 
climate,  trade  and  commerce,  and  communication 
patterns ) ; 

o  "Kindred  spirits"  (feelings  of  natural  kinship  and 
professional   ties) ; 

o  Existing  regional  alliances;  and 

o  Existing  R&D  performers   (McClure  1377). 


Federal  Specifications  for  Organization  ar^  Governance 

It  is  with  the  role  of     the  labs  in  the  regional  organizational 

matrix  that     the  RFP     goes  into  greatest     detail,  spelling     out  the 

requirements     in  three     tasks  and     two  statements     on  the  mission, 

functions,   and  governance  structure  as  follows  (NIE,  1984): 

o  Task     1:     Develop      effective     governance,  management, 
planning,  and  evaluation  systems 

o  Task  2:     Work  with     and  through     existing  organizations 
to  improve  schools  and  classrooms 

o  Task  3:   Work  with     state-level   decisionmakers  on  school 
improvement  issues 

o  Statement  4 :   La bora tor i es  serve  des i on a ted  reg  i  ons . 

o  Statement  5 .       Labor at or i  es  have     independent  govern  ing 
boards . 

A  central  notion  was  that  labs  must  be  both  independent  of  and 
neutral  toward  other  regional  organizations.  There  was  recognition 
that  education  has  diverse  stakeholders  and  that  the  labs  would 
have  to  be  able  to  work  with  all  of  them  without  taking  sides  in 
any  conflicts  that  might  exist  between  other  groups. 

In  most  major  respects  these  specifications  reflect  the 
conf igurat ional  perspective.  There  was  no  vision  of  the  1 abs 
playing  specialized  functional   roles  in     a  linear  flow  of  knowledge 
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from     producer  to     user.     Rather,     the  labs     were  expected     to  work 
"with  and  through"   other     school   Improvement  organizations,  forming 
temporary     systems  to     work     on     regionally  identified  educational 
problems,  rnd  providing  a  variety  of  gap-filling  R&D  services. 
Laboratory  Regions 

In  the  or  1 ginal  program  there  were  19  1 ab'  "at or ies  served  the 
contiguous  forty-eight  states,  and  one,  the  Center  for  Urban 
Education,  focused  on  educational  problems  in  „iajor  cities. 
Regions  tended  to  be  defined  in  ways  that  split  many  states  between 
two  or  more  laboratories,  and,  on  average,  there  were  only  about 
two  and  one-half  states  per  laboratory.  states  and  SEAs  were  not 
viewed  as  key  clients;  preference  was  given  to  working  directly 
with  schools  and  school  districts. 

Under  the  new  program,  only  nine  laboratories  serve  50  states, 
Puerto  Rico,  the  Virgin  Islands,  and  the  Pacific  Island 
Territories.  Regions  are  defined  as  groupings  of  whole  states,  and 
vary  in  size  from  four  to  nine  jurisdictions.  States  and  SEAs  are 
viewed  as  key  clients,  along  with  other  improvement  support 
agencies,  while  working  directly  with  schools  and  school  districts 
is  expected  to  be  the  exception  rather  than  the  rule. 

An  overview  of  the  characteristics  of  the  nine  regions  is  found 
in  Tabl e  1 .  These  are  not  necessar 1 1 y  the  most  important  or 
relevant  regional  indicators,  but  are  among  those  examined  by 
program  designers   (adapted  from  data  supplied  by  David  Mack). 

It  is  apparent  that  there  is  considerable  difference  among  the 
1  a bora t or y       regions     on       these     characteristics .         For  example, 
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enrollment  varies  from  2,055,000  in  the  NWREL  region  to  20,035,00 
in  the  NCREL  region.  Population  per  square  mile  varies  from  10  to 
383.      It   is  noteworthy  that  NWREL  stands     either     first     or   last  on 


Table  1 .     Characteristics  of  Nine  Laboratory  Regions. 


No. 

General 

Pub/Pvt 

Land 

Pop 

No. 

No. 

Poverty 

Lab/ 

States 

Pop 

Enrol  1 

Area 

Per  Sq 

Public 

Ed  R&D 

5-17  Y 

Region 

(000*s) 

(000*s)(sq  miles) 

Mile 

School s 

Orgs 

(000 's) 

AEL 

4 

15,548 

3,  150 

144,828 

107.4 

6,087 

125 

607 

FWL 

4 

28,647 

5,698 

461 , 763 

52.0 

8,877 

303 

778 

McREL 

7 

13,553 

2,694 

573,462 

23.6 

8,572 

176 

343 

NCREL 

7 

48,660 

10, 233 

379,331 

128.3 

20,035 

552 

1  ,272 

NE/I* 

9 

29,906 

6,818 

1  10, 782 

270.0 

9,441 

408 

948 

NWREL** 

7 

9,859 

2,055 

967, 043 

10.2 

5,049 

114 

226 

R8S 

5 

24,680 

4,899 

64,421 

383.  1 

7,828 

291 

C78 

SEDL 

5 

25,043 

5,347 

549, 203 

45.6 

1 0, 746 

180 

1  ,  072 

SEIL 

6 

30,609 

6,094 

289, 190 

105.8 

9,624 

271 

1  ,275 

TOT/AVG 

54 

226,505 

46,988  3, 

540, 023 

64.0 

86,259 

2,420 

7,199 

^Includes  Puerto  Rico  and  the  Virgin  Islands. 

** Includes  Hawaii,   Marianas,   Carolin3  and  Marshall    Islands,  and 

American  Samoa. 
Source:  OERI 


almost  every  characteristic.  It  has  the  largest  area  and  smallest 
population  and  consequently  the  lowest  density.  Its  poverty  level 
is  near  the  bottom  o*  the  range.  On  the  other  hand,  RBS  has  the 
smallest  area  and  highest  population  density,  but  is  closer  to  the 
averages  in  other  characteristics.  The  need  for  the  "with  and 
through"  strategy  is  evident  from  the  number  of  schools  in  each 
region,  ranging  from  5,0*9  to  20,035.  For  any  laboratory  to 
provide  direct  services  to  even  the  smal lest  number  would  be 
difficult  to  comprehend . 

Of     course  these     inter-region  variabilities     mask  considerable 
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intra-region  heterogeneity.  A  range  more  extreme  than  that  from 
New  York  City  to  the  Virgin  Islands  (NE/I),  or  from  Los  Angeles  to 
a  remote  county  in  Nevada  (FWL),  is  hard  to  imagine.  So  it  is  not 
homogeneity  but  logistics  that  justifies  a  regional  approach  to 
knowledge-based  school  improvement.  Major  metropolitan  areas  of 
all  regions  have  more  in  common  with  each  other  t han  with  rural 
areas  of  their  own  region,  and  vice  versa.  It  is  for  this  reason 
that  both  rural  and  urban  themes  assume  importance  for 
cross-laboratory  coordination  under  Task  5. 
Special  Considerations 

In  comparing  the  nine  laboratories,  several  special 
considerations  should  be  kept  in  mind. 

New  vs .  Old  Labs .  Six  of  tne  nine  laboratories  had  been  in 
existence  for  19  years..when  the  current  contracts  began.  Although 
they  had  to  make  adjustments  by  adding  or  subtracting  states  in 
their  region  or  changing  governance  structure  and  revising 
programs,  they  were  able  to  "hit  the  ground  running."  SEIL  was  a 
wholly  new  organization,  although  it  was  able  to  build  on  the 
experience  of  the  pre-existing  Southeastern  Council  for  Educational 
Improvement . 

NE/I  had  to  be  organized  as  a  new  governing  entity.  While 
operations  were  sub-contracted  to  an  experienced  school  improvement 
organization,  The  Network,  its  decentralized  structure  had  to  be 
created  and  a  new  program  put  in  place.  In  addition,  its  contract 
year  operates  three  months  ahead  of  other  labs.  Including  Puerto 
Rico  and  the  Virgin   Islands   in  the  region  added  considerably  to  the 
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heterogeneity  of  the  region. 

NWREL  was  an  experienced  lab,  but  the  decision  to  combine  the 
Northwest  and  Pacific  regions  made  the  task  more  com pi  ex . 

Finally,  NCREL  was  a  totally  new  organization,  but  had  been 
funded  one  year  earlier  than  the  others  and  so  was  actually  in  its 
second  and  third  years  of  operation  in  the  two  years  being  examined 
1n  this  study.  In  addition,  NCREL  was  originally  funded  through  a 
grant  rather  than  a  contract  and  was  not  subject  to  the  same 
reporting  requi  rements . 

In  sum ,  we  would  expect  that  NE/I  and  SEIL  woul d  be  just 
emerging  from  their  developmental  stage  at  the  end  of  FY  1987, 
while  NCREL  would  be  further  advanced  Into  program  operations. 

Changes  in  Region .  Among  the  experienced  labs  there  were 
numerous  changes,  adding  or  subtracting  states.  We  have  taken  the 
view  that  all  labs  are  continually  having  to  negotiate  their  role 
1n  relation  to  other  regional  organizations.  This  is  magnified 
when  one  or  more  additional  states  are  brought  into  their  orbit. 
So  we  might  expect  that  within  lab  regions  there  would  be  variation 
among  the  several  states  in  the  speed  with  which  a  lab  could  become 
ful ly  operational . 


In  designing  the  new  laboratory  program  the  government  was  not 
content  to  fund  laboratory-like  activities  in  a  variety  of 
organizational  contexts;  it  required  the  establishment  of  unique 
regional   organizations.     They  had  to     be  Independent  and  not  simply 


Governing  Boards 
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a  subsidiary  of  some  larger  organization,  such  as  a  university,  and 
still  hfcve  strong  ties  to  other  regional  educational  improvement 
organizations . 

The  board  of  di rectors  was  viewed  not  just  as  the  leg a  1 
mechanism  to  control  the  organization  but  also  to  provide  links 
between  the  lab  and  Its  major  constituencies .  This  has  both 
structural  and  functional  aspects.  (The  analysis  1n  this  section 
is  based  largely  on  the  Governance  and  Organizational  Status 
reports  of  1986  and  related  sections  of  the  proposals  for  1986-90 
and  1988-90.) 
Structure 

There  1s  a  major  continuing  problem  with  the  regional  basis  of 
laboratories.  In  our  system  of  government,  regional  institutions 
have  an*  Inherently  ad  hoc  charecter.  No  "laying  on  of  hands"  by 
OERI  can  give  labs  their  legitimacy,  although  support  and  funding 
by  the  Federal  government  are  Important.  Legitimacy  for  their 
mission  must  be  bestowed  by  other  regional  institutions.  For  this 
reason  the  governance  structure  of  each  Institution  is  crucial. 
The  key  role  of  chief  state  school  officers  (CSSOs)  in  legitimating 
labs  was  recognized  by  requiring  that  all  chiefs  be  offered  the 
opportunity  to  sit  or  be  represented  on  the  board  of  directors.  It 
was  further  requireH  that  the  board  reflect  "a  balanced 
representation  of  the  spates  in  the  region,  as  well  as  the 
interests  and  concerns  of  regional  constituencies"  (RFP  Post-Award 
Requ 1 remen ts ) . 

All   the  chiefs     have  accepted  invitations  to  sit     on  the  boards 
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or  send  their  representatives.  McREL  has  the  added  stipulation 
that  only  the  chiefs  can  vote;  their  representatives  can 
part ici pate  in  discussions  but  not  vote .  In  most  cases  the  chief 
is  listed  as  the  board  member,   but     in  at   least  one  case  (SEDL)  the 


serve  also  as  the  primary  SEA  liaison. 

All  labs  met  the  requirement  of  having  equal  representation 
from  the  states  in  their  region  (except  that  FWL  treats  California 
as  two  Sates,  Northern  and  Southern  California), 

Two  of  the  labs  also  serve  island  territories  of  the  United 
States,  NE/I  serves  Puerto  Rico  and  the  American  Virgin  Islands. 
Their  chief  education  officers  are  "permanent"  members  of  the 
board,  and  lab  bylaws  require  that  the  islands,  like  the  states, 
nust  have  at  least  two  members  on  the  41-person  board, 

NIE  originally  identified  a  tenth  region  consisting  of  Hawaii, 
American  Samoa,  Guam,  Northern  Marianas  Islands,  and  the  Trust 
Territory  of  the  Pacific  Islands.  However,  for  the  first  contract 
period,  this  region  was  combined  with  the  Northwest,  The  NWREL 
Board  serves  as  the  board  of  both  regions,  but  the  needs  of  the 
Pacific  Region  are  accommodated  by  the  establishment  of  the  Pacific 
Region  Policy  Board,  composed  of  CSSOs  and  other  educational 
leaders.  In  addition,  an  Indian  Policy  Board  represents  the 
Interests  of  Indian  populations  in  the  region.  The  relationship  of 
these  boards  to  the  NWREL  Board  is  not  explained,  and  their 
activities  are  not  described  beyond  such  general  1  ties  as  that  they 
meet  quarterly     and  "review     progress,   provide  planning     input,  and 


designees     are  listed     as     formal  members. 


These  persons  usually 
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establish  priority  activities"    (Plans  for  Years  3-5 ,   p.  6). 

Apart  from  the  CSSOs ,  the  boards  must  have  about  equal 
representation  of  educators  and  publ 1c  participants .  There  is 
consider a bl e  var iat 1on  in  how  they  are  selected .  In  most  cases 
both  educator  and  non-educator  slots  are  filled  through  a  process 
and  nomination  and  election  by  the  board  itself.  However,  some 
labs  have  a  process  whereby  state  advisory  committees  nominate 
(SEIL),  and  in  some  cases  elect  (NCREL),  board  members.  On  the 
public  side,  SEIL  allots  three  positions  on  a  rotating  basis  to  the 
chief  executive  officers  of  the  state  systems  of  higher  education. 

AEL  is  unusual  in  allotting  positions  to  the  "designated 
representatives  of  state  education  associations  (NEA  affiliates), 
school  administrator  associations  ( AASA. affiliates) ,  and  state 
associations  of  colleges  for  teacher  education  (AACTE  affiliates)". 
[AEL  Technical   Proposal   1985,   1v] . 

SEIL  allots  three  positions  on  a  rotating  basis  to  the  chief 
executive  officers  of  state  systems  of   higher  education. 

FWL  was  established  by  eight  public  education  agencies  who 
signed  a  "Joint  Powers  Agreement"  (amended  in  1986  to  add  a  ninth, 
the  Arizona  state  Board  of  Education).  Twenty-two  members  of  the 
board  are  appointed  by  the  nine  signatory  agencies,  while  seven  are 
appointed  by  the  Board  itself.  In  addition,  there  are  three  ex 
officio  members:  the  Director  of  FWL,  the  Director  of  Regional 
Programs,   and  the  Director  of  the  Southern  Service  Center. 

Public  members  of  lab  boards  are  drawn  from  "local  school  board 
members ,   parents ,     representatives  of   business  and     indust ry ,  state 
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legislators,  state  board  of  education  members,  and  the  community  at 
large"  (NIE  1*85,  15).  Thus,  the  "public"  portion  of  the 
membership  tends  to  include  many  individuals  with  formal  ties  to 
education.  For  example,  SEIL  provides  that  the  12  public  members 
will  be  drawn  from  the  following  "Client  Service  Groups"  on  a 
systematic  rotation  (SEIL  Bylaws,  Article  III,  Section  3). 
o  Business/industry  representative 

o  Intermediate  service  organization  representative 
o  Local   school  board  member 
o  Local   super  in ten dent 
o  Parent 

o  Private  school  official 
o  Principal 

o  State  board  of  education  member 
o  State  legislator 
o  Teacher 

It  was  not  possible  to  make  a  cross-lab  tabulation  of  board 
membership  because  labs  use  different  categories  in  reporting  and 
because  Individual  members  often  can  be  classified  in  more  than  one 
category.  Boards  of  directors  tend  to  be  large,  ranging  in  size 
from  20  to  41.  The  logistics  of  preparing  briefing  materials  and 
bringing  members  together  up  to  four  times  a  year  can  be 
formidable.  (One  lab,  SEIL,  reduces  some  of  these  costs  by  having 
only  annual  meetings  of  its  24-person  board  and  making  the 
six-person  executive  committee  the  primary  governing  body.) 

Laboratories  are  required  to  have  independent  governing  boards. 
The  meaning  of  this  requirement  seems  to  vary  among  the  labs.  In 
some  cases  (NCREL,  SEIL),  the  lab  and  the  funded  organization  are 
coterminous.  However,  laboratories  are  allowed  to  seek  funding 
from  other     sources  so  long     as  additional   work  is     consistent  with 
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the     lab     mission.       Some     labs,     like  FWL,     NWREL ,     and     RBS,  are 
considerably  larger  than  the  lab  contract,   and  the  OERI  funded  work 
1s  a     sub-set  of  the     organization's  work.     Thus,     technically,  the 
lab     1n     the  Western     Region     1s     the  Western     Regional  Laboratory 
(WREL),  also  Identified  as     Regional   Programs.     Immediate  oversight 
for  OERI  supported  work  1s  provided  by  the  Regional   Programs  Policy 
Steering  Committee  of     the  Board.     Similarly,   RBS     operates  the  Mid 
Atlantic  Laboratory     as  a     subunlt.     In     the  Northeast     the  winning 
bidder  was  a  n*w  consortium  (as  with     NCREL),   but  the  lab  was  to  be 
operated  by     one  of  the     members.   The  Network,   an     existing  service 
Improvement     organization  that     had  other     sources  of     support.  In 
this  case  The  Network  was  not  allowed  to  run  the  lab  as  a  sub-unit; 
rather,  a  new  Board  of  Overseers  was  formed  for  the  lab,   which  then 
contracted  with     The  Network  to     perform  lab  functions.       Note. that 
OERI     practice  1s     being  followed     1n  referring     to  the     labs.  The 
principle  seems  to  be  to  use  the  name  associated  with  the  cognizant 
board     of  directors.       Thus,   for     example,     the  Far     West  Board  is 
recognized  as  the     laboratory  board,   but  The  Network     board  is  not; 
there  1s  a     separate  "Board  of  Overseers"  for     NE/I.     The  coral lary 
1s  that  1t  1s     all   right  for  the  work  done     under  the  OERI  contract 
to  be     part  of     a  larger  organization     1f  that     larger  organization 
Identifies  Itself     as  the     regional   educational   laboratory     and  all 
work  done  by  the  larger     organization  1s  reasonably  consistent  with 
the  lab  mission. 
Funct 1 ons 

Laboratory  boards  have  the  usual   functional   responsibilities  of 
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corporate  boards,  Including  establishing  policy  and  monitoring  the 
performance  of  management .  Al 1  operate  under  bylaws  and  have 
established  impressive  arrays  of  policy  manuals  that  cover  topics 
such  as  personnel,  contract  administration,  travel,  and  property 
administration;  but  they  are  of  little  Interest  for  present 
purposes . 

Two  other  sets  of  functions,  however,  deserve  mention.  While 
planning  and  evaluation  are  regular  functions  of  corporate  boards, 
they  are  particularly  crucial  functions  for  laboratories ,  and 
boards  are  expected  to  play  multiple  roles  at  different  stages  of 
the  complex  planning  process*  This  will  be  discussed  1n  more 
detail   1n  the  section  on  planning. 

In  addition,  lab  board  members  are  expected  to  pi  ay  a  role  1n 
taking  lab  messages  back  to  their  constituencies  and  giving  the  lab 
visibility.  As  an  example,  here  1s  how  NE/I  phrases  these 
responsibilities  (Governance  and  Organizational  Status  Report ,  Vol . 
J[,  no  page  number): 

CONSTITUENCY  BUILDING  AND  COMMUNICATION 

o  Approve  eligible     schools,   school     districts,  agencies, 
and  organizations  for  affiliation  with  the  Laboratory* 

o  Build     and     strengthen     relationships     with  Laboratory 
constituents,   clients,  and  the  general  public 

o  Serve  as  a     channel  of  communication  from     the  field  to 
the  Laboratory 

o  Create  Laboratory  visibility 


*Th1s  provision  was  later  deleted.  The  lab  still  has  affiliates, 
but  there  1s  *  no  formal  approval  process  (letter  from  Glen  Harvey, 
12/6/8H). 
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While  not  all  labs  are  this  explicit  abcjt  these  functicns,  it 
seems  pretty  clear  that  these  expectations  generally  obtain  for 
members  of  all  lab  boards.  Here  again,  we  see  that  the  laboratory 
board  is  expected  to  assist  the  laboratory  in  negotiating  a  niche 
in  the  regional  educational  infrastructure. 

Organization  and  Staffing 

The  problem  of  how  to  organize  a  regional  educational 
laboratory  is  complex.  It  includes  several  issues:  program 
structure,  organizational  structure,  the  part/whole  problem, 
organizational  models,  partnerships  and  networks,  and  methods  of 
augmenting  staff. 
Program  Structure 

The  structure  of  programs,  projects,  and  activities  derives 
from  three  major  factors:  (a)  the  task  structure  mandated  by  the 
government,  (b)  the  priority  areas  chosen  as  a  result  of  the  needs 
and  capabilities  assessment  process,  and  (c)  educational 
improvement  and  linkage  strategies  appropriate  to  the  problems  and 
contexts . 

The  task  structure  required  for  government  accountability 
obviously  has  to.be  accommodated,  but  it  preseqts  its  own  problems. 
Only  AEL  and  RBS  use  a  simple  classification  of  p-ograms  by  task; 
All  others  use  some  form  of  a  matrix  design  for  at  least  some  tasks 
and  program  structures. 

Task  1,  relating  to  governance,  organization,  planning,  and 
evaluation,     is     relatively     straightforward.     Virtually     all  labs 
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assign  responsibility  to  the  Office  of  the  Director.  If  they  have 
a  special  staff  unit  for  planning  and  evaluation,  that  unit  has  a 
major  responsibility  for  parts  of  the  task  dealing  with  needs 
sensing,  capability  assessment,  self -assessment ,  and  planning.  In 
a  few  cases  specific  assignments  are  made  to  line  units. 

Similarly,  Task  3,  work  with  state-level  decisionmakers  on 
school  improvement  issues,  tends  to  be  a  self-contained  program  or 
project,  although  NE/I  parcels  out  six  Task  3  activities  among  four 
programs  and  SEDL  distributes  10  activities  among  four  programmatic 
themes . 

Initially,  Task  5,  collaborative  activities,  was  a  placeholder 
1n  that  the  specific  projects  had  to  be  planned  after  the  award. 
For  most  themes  it  took  two  years  to  develop  plans.  Plans  for 
years  three  through  five  describe  11  collaborative  projects,  but 
not  all  labs  participate  in  all  projects.  Where  there  is  a 
correspondence  or  fit  between  the  collaborative  theme  and  another 
program  or  project,  such  as  evaluation  or  state  policy 
collaboration,   most  labs  assign  the  theme  to  that  program. 

The  major  problem  comes  in  dealing  with  Tasks  2  and  4,  which 
represent  the  core  of  the  program  and  were  expected  to  absorb 
between  60  and  80  percent  of  program  effort.  Task  2,  "with  and 
through,"  is  a  mode  of  operation,  not  a  task  1n  the  traditional 
sense,  although  it  tends  to  be  interpreted  as  the 
dissemination/utilization  function.  On  the  other  hand,  Task  4, 
"work  to  create  research  and  development  based  resources  for  school 
improvement"   (emphasis  added),   is  ambiguous     and  turns  out  to  be  an 
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umbrella  that  covers  everything  from  applied  research  to  collection 
of  promising  practices.  The  RFP  does  allow  the  conduct  of  applied 
research  or  action  research. 

McREL  initially  adopted  a  very  narrow  interpretation  of  this 
task.  No  separate  projects  were  Identified  for  Task  4;  rather,  the 
materials  development  activities  of  projects  under  Tasks  2  and  3 
were  classified  as  Task-  4.  (In  the  plan  for  1988-90  a  new 
demonstration  program  1n  local  sites  has  been  formulated  -  a 
different  Interpretation  of  Task  4,  and  of  the  "with  and  through" 
mandate. ) 

Two  of  the  labs  ( AEL  and  RBS)  appear  to  have  self-contained 
program  units  organized  by  task  (although  RBS  may  have  a  modest 
amount  of  matrlxing).  But  most  labs  use  some  matrlxing  across 
Tas-ks  2  &  4  in  which  programs  and  projects  are  distributed  across 
these  two  (and  sometimes*  other)  tasks.  Generlcally,  such  programs 
look  like  this: 


Task  2 

Task  4 

Program  A 

Project  1 

Activity 

1  . 

1 

Act  ivity 

1 

.3 

Activity 

1  . 

2 

Project  2 

Activity 

2. 

1 

Act  ivlty 

2 

.2 

Act  iv1 ty 

2 

.3 

Program  B 

Project  3 

Activity 

3. 

1 

Act  ivlty 
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Project  4 

Act Ivity 
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FiQure  li.  Generic  Matrlxing  of  Tasks  and  Programs 


Organizatlona 1  Structure 

Whether  such     a  program     structure  represents     t he  way     t he  lab 
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operates  or  simply  an  accounting  device  depends  on  the 
organizational  structure  chosen.  If  the  organizational  units 
coincide  with  programs  and  most  work  on  the  program  and  projects  is 
done  within  that  unit,  then  a  program  matrix  such  as  that  in  Figure 
1  1s  just  a  way  of  being  able  to  report  to  OERI  in  terms  of  the 
task  structure.  If  the  lab  is  organized  by  tasks  or  functions, 
program  work  is  likely  to  be  distributed  across  units.  Virtually 
all  labs  have  some  functionally  specialized  units  for  information 
dissemination  that  provide  support  to  program  inlts. 

While  seven  of  the  nine  labs  use  some  degree  of  matrix 
management,  SEDL  is  strongest  in  its  avowal  of  this  approach. 
Generically,  its  structure  for  organizational  units,  tasks,  and 
themes     looks     like     Figure     2.       In     this     organizational  design, 

C)RGAN  IZAT  IONAL  UNITS  (GROUPS) 
I       -  II  III 

School  Improvement  School  Improvement  LMC& 
Services  Group  Resources  Group  OCDM 


Task  2 


Task  3 


Task  4 


Task  5 


Themes 
A 


e 


e 


Figure  3;  Matrix  Organization  of  SEDL 
(Adapted  from  Proposal ,   p.  56). 

*Lab  Management  Council  and  Office  of  Communication  and 
Devel opment . 
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programmatic     themes       are     further     divided     into       subthemes  and 

activities.     Tasks  2     and  3  are  assigned  to     the  School  Improvement 

Services  Group,     which     implements     knowledge     utilization  efforts, 

while  lask  4   is  assigned  to  the  School    Improvement  Resources  Group, 

the     knowledge     production     unit.       Task       5     is     assigned     to  the 

Laboratory  Management  Council   and     the  Office  of  Communications  and 

Development .       Thus ,  the     organizational     units     correspond  to  the 

tasks,   but     programs  are     matrixed  across     functionally  specialized 

units.     The  main     axes  of  coordination  seem  to     be  for  programmatic 

themes,   in  charge  of  program  coordinators. 

It  may  ba     helpful  to  provide  a  short  description     of  each  lab, 

combining     aspects  of     program  <jnd     organizational   structure.  The 

list     is  roughly     in  order     of  complexity,     starting  with     the  most 

simple  arrangement . 

NCREL.  A  small  laboratory  with  a  small  staff. 
Functionally  integrated  and  ^hematically  designed  program 
units  operate  prSjects.  Ta^k  activities  are  identified 
only  for  OERI  accounting. 

AEL.  IntermeGiate  size.  Six  urograms  ara  grouped  into 
three  tasks  and  appear  to  have  tie  i  f -contained  staffs.  An 
attempt  to  obtain  the  contributed  services  of  retired 
professors  was  abandoned . 

SEIL.  A  small  laboratory  with  a  small  staff.  Ten 
thematlcally  defined  projects  operate  under  four 
programs,  but  neither  programs  nor  tasks  seem  to  be 
significant  management  categor  ies .  Projects  are  staffed 
by  teams  of  individuals  with  multiple  assignments  and 
roles.  There  is  reliance  on  positions  contributed  by 
SEAs  and  state  systems  of  higher  education.  Also  several 
.  rojects  are  contracted  out  with  the  use  of  RFPs . 
R8S.  A  large  laboratory  with  three  non-lab  programs. 
Six  OERI  programs  in  six  functionally  defined  units 
correspond  to  five  tasks   (two  programs  in  Task  4 ) . 

McREL.  Small  organization.  Like  SEIL,  projects  are 
staffed     by     individuals     with  multiple     assignments  and 
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roles.  Lab  1s  nominally  organized  by  task,  and  there  are 
task  coordinators.  Work  1s  matrixed  across  "strategies" 
or  functions.  Task  4  is  subsumed  under  Tasks  2,  3,  and 
5. 

NWREL.  A  large  organization  with  a  significant  amount 
of  non  OERI  work.  Heads  of  functional ly  defined  programs 
supervise  projects  centers,  or  services.  Six  programs 
(partly  functional,  partly  thematic)  are  matrixed  across 
organizational  units  and  tasks.  Tasks  appear  to  be 
mainly  OERI  accounting  categories. 

NE/I .  Intermediate  size  with  decentralized  structure. 
Six  thematic  programs  operated  under  Field  Services  for 
Tasks  2,  3,  and  4,  with  team  staffs  drawn  from  both 
headquarters  and  assist  ance  center  units .  Executive 
Director,  Associate  Director,  and  Director  of  Planning 
and  Communications  have  pieces  of  Tasks  1  and  3 .  (This 
1s  descriptive  of  the  lab  for  the  period  covered  by  this 
report.  Subsecuent ly ,  1n  January,  1988,  the  lab  dropped 
the  term  "assistance  center",  consolidated  program 
functions  1n  the  central  office,  and  focused  field  staff 
efforts  on  field  activities.) 

SEDL.  Intermediate  size.  Tw?  functionally  defined 
groups,  School  Improvement  Services  (Tasks  2  and  3)  and 
School  Improvement  Resources  (Task  4)  plus  the  Office  of 
the  Director  (Tasks  1  and  5)  matr 1x  work  across  four 
programmatic  themes ,  subdivided  Into  subt hemes  and 
activities.  Accountability  to  .  ERI  is  by  task,  but 
organizational   goals  are  stated  1n  terms  of  themes. 

FWL/WREL.  Large  organization  in  which  the  Western 
Regional  Educational  Laboratory  (WREL)  1s  a  unit  of  FWL. 
The  Field  Services  D1 rector  1s  responsible  for  Tasks  2 
and  4 ,  which  are  matrixed  across  three  thematic  programs 
plus  functionally  specific  units  as  necessary.  Tasks  1 
and  3  parcelled  out  among  staff  units  associated  with  the 
WREL  management  group.  Has  task  coordinators  1n  addition 
to  line  supervisors.  Partial  decentralization  through 
establ Ishment  of  the  Southern  Service  Center  at  CSU 
Northrldge  and  placement  of  field  agents  in  state 
capitals  to  serve  the  Task  3  Policy  Support  Services 
Program . 


Looking  ac  -oss  the  labs,  1t  1s  Interesting  that  degree  of 
complexity  is  not  closely  associated  with  size.  No  doubt  some  of 
the  complexity  could     be  reduced   1f  OERI  defined  tasks     in  a  manner 
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more  compatible  with  program  organization. 
The  Part/Whole  Problem 

Laboratories  are  all  owed  to  take  on  work  in  addi  tion  to  that 
funded  by  the  lab  contract,  and  in  some  cases  the  total 
organization  is  considerabl y  1 arger  than  the  lab.  This  raises  the 
question  of  how  the  lab  is  distinguished  from  the  larger 
organization  in  the  organizational  plan. 

In  some  cases  the  Tab  is  a  sub-unit  of  the  organization.  Thus, 
the  Western  REL  is  coterminous  with  the  Regional  Program  of  FWL  and 
is  headed  by  its  own  director,  who  reports  to  the  Director  of  FWL. 
On  the  other  hand,  RBS  uses  a  much  more  informal  mechanism;  of 
their  nine  programs,  six  make  up  the  lab  and  the  other  three  are 
outside  of  it.  All  program  heads  report  directly  to  the  RBS 
Executive  Director. 

McREL  is  somewhere  in  between.  The  executive  director  of  the 
lab  wears;  a  second  hat  as  principal  investigator  under  the  lab 
contract .  He  then  delegates  res  pons  ibi  lity  for  lab  tasks  2-5  to 
the  Coordinator  of  Lab  Programs  while  retairing  responsibility  for 
Task  1.      (It  is  not  clear  how  non-lab  work  is  administered.) 

The  relationship  between  NE/I  and  The  Network  is  complex.  The 
lab  proposal  was  submitted  by  a  cr nsortium  of  regional 
organizations,  for  which  The  Network  was  the  fiscal  agent.  As  a 
result  of  negotiations  with  OERI,  KE/I  was  established  as  a 
separate  legal  entity  with  its  own  board,  and  the  conduct  of  work 
is  subcontracted  to  The  Network.  For  its  part,  NE/I  operates  the 
laboratory  as     a  separate     organizational   unit,     but  there     is  some 
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sharing  of  personnel   with  other  units  that  are  funded  separately. 

Other  labs  do  not  say  specifically  how  they  handle  the  problem; 
presumably  non-lab  programs  and  projects  are  identified  as  separate 
work  units  below  the  office  of  the  director. 

Both  here  and  1n  the  discussion  of  the  Independence  of  governin 
boards  above  we  observe  one  of  those  continuing  issues  that  defies 
resolution.  So  long  as  lab  can  seek  additional  sources  of  funding 
(which  may  be  necessary  for  their  viability)  the  work  done  under 
the  OERI  contract  1s  part  of  some  larger  whole  and  cannot  be 
total ly  Independent . 
Organizational  Models 

Several  labs  based  their  organizational  design  on  a  thoughtful 
examination  of  recent  organization  theory  and  research ,  notably 
McREL,   FWL  and  NE/I. 

Citing  the  theory  of  William  Ouchi,  McREL  opted  for  the  "M" 
model  rather  than  the  U-Form  or  H-Form.  The  "M"  model  1s  a 
variation  of  matrix  management  that  creates  Independent  units 
res pons 1 ble  for  task  specif  1c  activities  and  products  but  uses 
common  service  units.  The  maintenance  of  a  business  office  and 
field  staff  1n  Kansas  City  seems  to  be  for  logistic  and  historical 
reasons . 

FWL  had  a  history  of  being  more  like  a  research  center  than  a 
regional  laboratory.  Not  only  were  they  more  heavily  weighted 
toward  knowledge  production  than  knowledge  utilization,  they  also 
operated  with  a  high  Heoree  of  principal  Investigator  autonomy  and 
a  minimum  of  programmatic  control.     In  planning  for  operation  under 
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the  new  laboratory  program  they  recognized  the  need  to  rethink 
these  matters.  They  have  str  ived  for  an  "organic"  form  of 
organization  highly  adaptable  yet  integrated  in  its  functions  and 
activities.  The  organizational  design  incorporates  a  limited 
amount  of  decentralization.  A  formal  relationship  was  established 
with  the  California  State  University  (CSU),  in  part  to  create  a 
presence  in  Southern  Cal if ornia  where  it  had  not  previously 
operated.  The  FWL  Southern  Service  Center  was  established  on  the 
campus  of  CSU  Northridge.  In  addition.  Task  3  places  field  agents 
in  the  state  capitols  of  Arizona,  Nevada,   and  Utah. 

NE/I  was  unique  in  Its  initial  degree  of  decentralization.  In 
the  1960s,  when  the  infrastructure  of  educational  improvement  was 
far  more  primitive,  a  number  of  labs  had  tried  decentralized 
structures.  These  regional  offices  were  soon  discontinued  because 
it  was  too  difficult  to  keep  field  agents  involved  in  and  up  to 
date  with  lab  activity  (Salmon-Cox,  1980).  NE/I  felt  that,  in  a 
new  era  when  the  role  of  the  lab  1n  working  with  other  SIOs  was 
paramount,  a  new  attempt  at  decentralization  was  required.  Their 
10  assistance  centers  were  not  freestanding ,  however ;  they  were 
housed  in  school  improvement  organizations  that  were  part  of  the 
consortium  sponsoring  the  lab  proposal.  Some  difficulties  were 
encountered  with  this  approach.  It  had  to  be  fine-tuned  during  the 
first  eighteen  months,  and  was  abandoned  in  the  second  quarter  of 
the  third  year.  More  specifically,  some  field  staff  were  retained 
for  field  functions,  and  the  term  "assistance  center"  1s  no  longer 
used     for  field     units.     What     was     terminated  was     the  attempt  to 
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Involve  field  staff  in  program  teams  with  central   office  staff. 
Partnerships  and  Networks 

Perhaps  there  was  a  day  when  it  was  clear  where  one 
organiztion  stopped  and  the  next  began ,  but  no  longer.  In  this 
day  of  partnerships  and  networks,  ties  between  organizations  seem 
to  have  infinite  gradations.  We  have  already  seen,  in  the  section 
on  governance,  how  other  organizations  or  organizational  sectors 
are  formally  represented  on  the  lab  boards  of  directors.  In 
chapters  below  we  will  see  how  adjunct  structures  such  as  state 
advisory  committees  are  created  for  needs  assessment,  evaluation, 
or  dissemination,  and  will  examine  how  the  "with  and  through"  task 
is  implemented  with  partnerships,   networks  and  other  arrangements. 

One  example  will   be  presented     here  to  demonstrate  how  deeply  a 

lab  can     be  embedded  in     its  organizational   context.     AEL     has  very 

close     ties  to     four  other     organizational   sets:     the  CSSOs ,  state 

teachers  associations,   state  administrators  associations,   and  state 

teacher     education  associations.       These  ties     operate  on     at  least 

four  levels.     Each  organizational  set: 

o  Has  a  state  representative  on  the  board  of  directors 

o  Has  one  or  more  lab  programs  dedicated  to  working  on 
its  probl ems 

o  Provides  advisory  oversight  for  the  dedicated 
program(s)  through  an  advisory  committee  of  the  board 
made  up  of  the  set  representatives  on  the  board. 

o  Provides  staff  for  the  dedicated  program  in  the  form  of 
shared  staff,   contributed  staff,   or  volunteers. 

To  sum  up,   lab  organizations  are  not  stamped  from  the  same  mold 


They  exhibit  considerable  variation     both  in  internal   structure  and 
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ways  of     relating  to  other     organizations.     The  common     threads  are 
the  need     for  flexibility  1n     staff  assignments  and  the     desire  to 
establish     structures     that     assist     them  in     being     responsive  to 
envl ron mental   press . 
Staffing 

A  number  of  questions  concerning  staffing  might  be  of  interest. 

Unfortunately,    1t   1s  not   feasible  to  address  those  concerning  staff 

characteristics,   such  as     whether  they  are  drawn     from  the  research 

or  practice  communities,   from  the  behavioral   science  disciplines  or 

education ,     expert 1se  1n     R&D     functions     and/or  education     probl em 

areas,  etc.     But     organizationally  the  labs  had     several   choices  to 

make.     All   have  a  ccros  or  full-time  staff,   although  in  many  if  not 

most  cases  there  is  some  splitting     of  time  between  lab  and  non-lab 

work.     Variation  cones     1n  the  degree  to  which  that     core  staff  are 

supplemented     by  part-time     ©recontributed     staff,   consultants,  or 

sub-contractors.     Here  1s  a   run-down  of  some  patterns: 

o  AEL:  Has  a  core  staff  1n  a  central  location  with  no 
field  offices.  The  program  on  Professional  Preparation 
and  Resources  1s  run  by  four  20%  faculty  members  in 
area  universities .  Sel f -assessment  is  conducted  parti y 
through  a  subcontract  for  a  third-party  evaluation-  An 
attempt  was  made  to  engage  ret  1  red  personnel  on  a 
voluntary  basis,  but  was  abandoned.  A  program  of 
Extern  Grants  provides  1 ow  1 evel  support  for  doctora 1 
dissertations  and  f acu 1 ty  research . 

o  FWL:  Has  a  core  full-time  staff  1n  San  Francisco  and  a 
"Southern  Service  Center"  on  the  campus  of  the  CSU  at 
Northrldge.  In  addition,  state  assistance  field  agents 
(.2  FTE  each)  are  located  4n  Nevada,  Utah,  and  Arizona. 
In  connection  with  Task  3,  a  university  faculty  member 
1n  each  of  these  three  states  serves  as  a  State  Policy 
Field  Agent.  Consultants  are  to  supplement  staff  where 
specialized  expertise  1s  required  for  limited  tasks. 
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o  McREL:  Has  very  small  core  staff  in  Colorado  plus  field 
office  1n  Kansas  City  mostl y  for  management  support 
functions.  Commissions  some  papers  and  does  some 
subcontr acting 

o  NCREL:  Has  vary  small  core  staff  in  Elmhurst,  IL.  Uses 
contributed  staff,  consul t ants ,   and  subcontractors. 

o  NE/I:  Prior  to  Its  1988  reorganization,  had  core  staff 
in  Andover ,  MA,  with  some  staff  shared  with  other 
Network  projects?  other  staff  in  10  assistance  centers 
(three  1n  Andover  and  seven  in  field  sites  in  host 
agenc  ies ) . 

o  NWREL:  core  staff  operating  out  of  headquarters  1n 
Portland;   field  office  for  Pacific  Region  in  Honolulu. 

o  RBS:  large  core  staff  plus  considerable  cost-sharing 
from  partners   in  form  of     contributed  staff 

o  SEDL:   central   staff  operates  out  of  Austin  TX. 

o  SEIL:  very  small  core  staff;  considerable  use  of 
subcontracts  and  consul tants . 

Thus     the  labs     exhibit  considerable     variation  in     staff  size, 

reliance  on     consultants,   contributed     staff,   and     contractors,  and 

placement  of  staff  in  one  or  multiple  locations. 


Comments  on  Governance  and  Organization 
The     concept     of     regionalism     in     education     was  examined.  It 
appears  that  there     is  as  much  variation  within     regions  as  between 
them  and  that     the  primary  need  for  a  regional     approach  to  the  lab 
mission  lies  in  logistical  considerations. 

The  nine  regions  served  by  the  laboratories  vary  considerably 
1n  educational  and  demographic  characteristics.  While  we  continue 
to  view  the  organizational  infrastructure  of  the  several  regions  as 
loose  and  fluid ,  it  seems  clear  that  the  labs  have  managed  to 
establish       important       mechanisms       that     link       them       to  other 
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organizations  at  the  governance  level ,  chiefly  through  pol icies 
concerning  membership  on  the  board  of  directors  and  establishment 
of  various  advisory  groups  and  other  adjunct  structures.  The 
organization  of  the  labs  at  the  regional  level ,  outside  the  formal 
structure  of  the  educational  system,  has  its  weaknesses.  However, 
it  is  the  very  looseness  of  the  educational  configuration  that 
seems  to  require  an  organization  like  the  labs  to  play  a  catalytic 
role  in  bringing  the  disparate  parts  together  in  greater  ha rmony . 

All  labs  group  projects  into  programs .  For  a  few  the  programs 
correspond  to  RFP  tasks,  but  for  most  the  programs  are  spread 
across  the  tasks.  Most  labs  are  quite  sel f -conta ined  regarding 
staff,  although  all  use  consultants  and  sub-cont racts  from  time  to 
time.  For  a  few,  the  use  of  outside  resources  is  more  than 
inc  identa 1 . 

The  task  structure  formulated  in  the  RFP  may  be  valuable  for 
clarifying  the  mission  of  laboratories,  but  it  does  not  seem  to 
provide  a  useful  way  for  labs-  to  organize  their  programs  or  report 
to  OERI .  Whether  some  form  of  matrix  management  is  needed  to 
provide  flexibility  or  merely  provides  a  cross-walk  for  reporting 
to  OERI  by  task  is  not  clear. 
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CHAPTER  III 

PLANNING* 
Introduction 

Federal  Specif Ications 

An  orientation  toward  rational  systems  is  most  evident  in  the 
required  planning  component.  The  RFP  lays  out  three  subtasks  under 
Task  1   (NIE  1984)  : 

1.2  Assess  regional  needs,  capabilities,  and  oppor- 
tunities and  establish  priorities  for  laboratory 
activity . 

1.3  Prepare  revised  plans  for  future  services. 

1.4  Conduct  self-evaluation  of  laboratory  projects  and 
services . 

The  text  under  these  subtasks  reveals  a  complex  and  sophisticated 
model  of  planning  and  management.  Needs  are  to  be  assessed  with 
such  mechanisms  as  advisory  committees,  surveys,  content  analysis 
of  media,  and  documentation  of  lab  activities.  Self-assessment  is 
expected  to  serve  a  formative  evaluation  function  and  feedback  Into 
the  planning  cycle.  The  board  cf  directors  should  play  multiple 
roles  as  both  a  source  and  a  consumer  of  needs  and  self -assessment 
inf ormat ion  . 

In  add  it  1  on ,  ea'jh  lab  must  conduct  a  census  and  analysis  of 
R&D  and  service  improvement  organizations  1n  the  region  to  assess 
the  capacity  of     the  improvement   Infrastructure  in     relation  to  the 

^Planning  done  under  earlier  planning  grants  1s  not  part  of  this 
review  except  as  it  1s  reflected  in  the  plans  for  1986-90. 
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the  needs  identified  as  well  as  to  its  own  capacity.  Analysis  of 
these  data  l9ads  to  setting  priorities  and  planning  specific 
programs  and  services .  This  process  is  viewed  as  continuous ,  and 
useful  for  both  fine-tuning  day-to-day  operations  and  making  major 
program  planning  decisions,  such  as  devel oping  the  three-year  pi  an 
for  1988-90. 

Each  lab     was  asked  to  provide     a  graphic  display  of     the  total 
process.     To     illustrate.   Figure  5     shows  the  process     described  by 
FWL/WREL,  which  is  typical.     Shown  as  a  systems  chart,   it  indicates 
the  highly  rational   and  complex  set  of  tasks  required. 
Planning  Models 

The  process  described  above  seems  to  represent  the  convergence 
of  thinking  from  several  conceptual  starting  points.  "Evaluation," 
"needs  assessment , "  and  "planning"  have  all  been  used  as  the  master 
concept  subsuming  all  stages  of  the  process.  For  example,  under 
the  evaluation  rubric..  Stuff lebeam  et  al  (1971)  developed  the  CIPP 
model   that  encompassed  these  processes  under  the  headings  of: 


Beginning  with  a  system  approach  to  planning,  Kaufman  (1979) 
elaborated  six  types  of  needs  assessment ,  each  associated  with  one 
of  the  six  steps  of  a  general   systems     problem-solving  model: 


Context  eval uat ion 
Xnput  evaluation 


Process  evaluation 
Product  eval uat ion 


Al pha  : 


Identify  problem  based  upon  need 


Beta  : 


Determine  solution  requirements  and  identify 
solution  al  tern<jt  ives 
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Figure  4.   The  Far  West  Laboratory  Planning  Process 
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Gamma : 


Select  solution  strategies  from  among 
a  1 ternatives 


Delta : 


Implement 


Eps 11  on :   Determine  performance  effectiveness 


Zeta  : 


Revise  as  required 


Similarly,     working  from     a  chain     model   of     educational   needs , 

Waks  (1979)  identifies: 

Context   inqul r ies 

Attainment  needs 

Process  needs  assessment 

Maintenance  needs  assessments 

Resource  needs  assessments 
o  Personnel  assessments 
o  Organizational  assessments 
o  Facilities  assessments 
o  Financial  assessments 

Finally,  a  field  of  strategic  planning  has  been  elaborated  that 
encompasses  external  environmental  scanning,  internal  capacity 
analysis ,  participation  and  involvement ,  mission  and  strategic 
goals ,  impl ementat 1on/l inkage  pi ans ,  and  moni tor ing  and  assessment 
(Steiner  1979;  McCune,  no  date).  Several  labs  have  explicitly  used 
variations  of  strategic  planning   (McREL,  SEIL). 

All  these  models  cover  more  or  less  the  same  set  of  processes 
but  use  a  different  master  concept ,  depending  on  the  start  ing 
point.  For  our  purposes  it  is  only  necessary  to  note  that  the 
writers  of  the  lab  RFP  specified  a  set  of  requirements  for  Task  1 
that  was  consistent  with  these  different  traditions. 

From  an  examination     of  these  models  and     the  subtasks  required 
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of  the  labs,   the  following  general   planning  model   can  be  Inferred: 

Regional  Needs 


^  Laboratory  Prog  ram 


Regional^  J/     ^  Laboratory 


Capacity  ^  Capacity 

Figure  5 .     Strategic  Planning  Model . 

According  to     this  model,    the     lab  first  assesses     the  region's 
needs  and  the  capacity  of  Its   Infrastructure  to  meet  them-      It  then 
derives  Its  program  from  this  analysis  and  an  assessment  of   Its  own 
capacities . 
Issues 

This  highly  rational  planning  process  appears  to  be  in  tension 
with  the  previously  noted  recognition  that  labs  must  operate  1n  a 
fluid  configuration  of  educational  agencies.  Lindblom  and  Cohen 
have  argued  that  social  problem-solving  1s  basically  an  Interactive 
process  and  does  not  evolve  1n  any  simple  way  from  professional 
social  Inquiry  (1979).  Clark  maintains  that  plans  more  often 
represent  an  understanding  of  what  has  already  been  done  rather 
than  a  useful  prescription  for  future  action  (1980).  Whether  the 
Imposition  of  rational  planning  methods  on  the  labs  represents  a 
conf 1 1ct  and  Inconsistency  or  whether  the  planning  process 
constitutes  a  useful  adaptive  mechanism  for  operating  in  a 
non-rat 1onal  environment  is  something  I  hope  will  emerge  from  the 
analysis.  Other  Issues  concern  the  extent  to  which  the  general 
model     has   been     1mpl emented ,   and     t  he     degree  to     which  plans  and 
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activities  flow  logically  from  the  planning  process. 
Organization  of  Chapter . 

The  sections  that  follow  discuss  each  of  the  major  components, 
need£  sensing,  capacity  assessment,  and  sel f -assessment  in  turn, 
and  exam.ne  how  the  planning  and  management  process  all  fits 
together . 


Theoretical  Basis . 

p,  3ds  sensing  or  assessment  seems  to  correspond  to  conter*- 
evaluation  in  CIPP  model,  contextua*  inquiry  in  WaksT  model,  and 
environmental  scanning  in  strategic  planning.  While  the  idea  of 
measuring  educational  needs  appears  intuitively  simple  and 
straightforward,  Waks  (1979)  points  out  are  at  least  four  meanings 
of  "need" : 


o  The  norm-based  sense  of  need:  something  required  by  a 
prescriptive  rule  or  law,  e.g.  "one  needs  a  license  to 
go  fishing  here" 

o  The  goal-based  sense  of  need:  a  necessary  means  to 
atta inment  of  ?n  expl ic i t  joa 1 

o  The  motive  senses  of  need:   a  want  or  desire 

o  The  injury  rense  of  need:  when   lack     causes  harm 


These  senses     are  not     mutually  exclusive.     The     labs  primarily 
seem     to  use     a  goal -based     sense  of     need  with     some  overtones  of 


Needs  Assessment 


injury     or  gap. 


In  the     planning  context,     needs  assessments  are 


practical  ways  for  measuring  needs  and  therefore  goals. 


Goa Is  are  an  important  focus  in  most  needs  assessment 
studies.  Sy  determining  needs,  goals  are  being  verified 
or  validated ,  selec  wcd  from  ternat ives ,  refined ,  or 
converted       into       more       specie  ic       objectives.  Needs 
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assessments  are  tools  for  determining  the  goals  of  a  service 
agency  (Waks   1979,   p.  63). 

The     sine  qua     non  of     a  laboratory     is  its     orientation  toward 
meeting  regional   educational  needs.       The  needs  assessment  function 
is  thus  the  keystone  activity,     and  inquiring  about  the  sources  and 
methods  used   in  determining  those  needs   is  essential . 
Sources  and  Methods* 

As  has  been  noted  above,  all  labs  rely  on  their  boards  of 
directors  to  some  extent  for  needs  sensing  input.  Staff  contacts 
and  information  gleaned  in  meetings  of  all  kinds  are  also 
important.  In  terms  of  more  formal  methods  of  data  collection  and 
analysis,  tremendous  variation  exists  among  the  labs.  Some  rely  on 
an  analysis  of  one  or  two  types  of  data,  while  others  (FWL,  NWREL) 
use  the  1987  report  to  summarize  a  long  history  of  detailed  studies 
using  a  wide  variety  of  data  sources. 

Adjunct     Structures .       The     first  method     of     needs  assessment 

involves     the  format i  on     of     adjunct  structures,     such  as  advisory 

committees     and  formal     partnershi ps .       In  general ,     there  are  two 

kinds  of     advisory  committees:   those     organized  by  state     and  those 

organized     on     a     program     or     project     basis .       The     new     1 abs  in 

particular     opted     for     el  a borate  advisory     structures .       Note  the 

f ol lowing  membershi  ps : 

o  NCREL:    140  members  in  7  State  Advisory  Councils 
o  NE/I:     219  members  in  9  Advisory  Committees  ("later 
dissolved) 


*This  section  is  based  largely  on  the  needs  and  capabilities  report 
required  as  a  contract  deliverable  as  part  of  the  continuation 
proposal  for  the  third  through  fifth  years.  Other  needs  data  are 
to  be  found  in  the  original  five-year  proposal . 
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o  SEIL:  109  members  in  6  State  Advisory  Committees 
Among  the  old  labs,  NWREL  and  SEDL  convened  ad  hoc  state 
advisory  groups  for  the  recompet 1t 1on ,  but  have  not  continued  to 
Involve  them  as  such.  (SEDL  has  Involved  some  of  the  same 
Individuals  1n  other  adjunct*  groups.)  State  advisory  committees  are 
partly  needs-sensing  mechanisms,  partly  dlssemlnat 1on/l 1a1son 
vehicles,  and  1n  some  cases  have  a  role  1n  the  governance  of  the 
lab  through  nominating  or  electing  board  members.  Committee 
discussions  make  1t  possible  for  representatives  of  different 
constituencies  to  share  and  compare  their  views  and  give  the 
laboratory  a  more  1n-depth  and  qualitative  view. 

It  1s  Interesting  to  speculate  on  why  the  new  labs  are  far  more 
likely  to  rely  on  adjunct  structures.  Perhaps  the  old  labs  are 
sufficiently  tied  1n  to  the  educational  Infrastructure  of  their 
regions  through  their  governance  and  program  activities,  while  the 
new  labs,  having  new  governance  and  program  structures  need  the 
additional  mechanisms  on  at  least  a  temporary  ^sis-  Note  also 
that  state  advisory  groups  are  cross-constituency  groups ;  they 
attempt  to  represent  a  cross-section  of  educational  stakeholders  1n 
the  state.  By  contrast,  the  older  labs  appear  to  favor  more  formal 
_  ties  to  specific  constituencies.  We  have  already  noted  how  four 
groups  are  represented  directly  on  the  Board  of  AEL,  and  how  nine 
signatory  agencies  appoint  22  members  of  the  FWL  Board. 

For  program     purposes,   RBS  has  established     formal  partnerships 
with  five  groups   (some  new,  some  pre-existing): 
o  Rural   Exchange  Network 

o  Maryland  Ccundl  of  Assistant  Superintendents 
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o  Intermediate  Units  of  Pennsylvania 

o  Mid-Atlantic  Metropolitan  Council 

o  Urban  School   Superintendents  of  New  Jersey 

Whi le  these  groups  serve  primar i ly  as  vehicl es  for  program 
operations ,   they  are  also  sources  of  needs  input . 

Program  and  project  advisory  groups  (to  be  discussed  more  fully 
in  connection  with  Tasks  2-4)  serve  primarily  as  input  for 
fine-tuning  existing  activities  rather  than  planning  new 
initiatives . 

Quantitative  Data ,  Labs  employ  a  wide  variety  of  methods  for 
gathering  quantitative  data,  including  surveys,  content  analysis  of 
media,  secondary  analysis  of  published  economic,  demograohic, 
social ,  and  educati  onal  indicators;  and  logs  of  program  activity 
such  as  telephone  contacts  and  services  requests.  The  profile  of 
methods  used  by  each  lab  is  shown  in  Table  2. 


Table  2.     Methods  Used  to  Collect  Needs  Assessment  Data. 


Lab 

Meetings 

Surveys 

Content 

Indicators  Documenta- 

Analysis 

tion 

AEL 

+ 

o 

FWL 

+ 

+ 

+ 

+  + 

McREL 

+ 

+ 

+  + 

NCREL* 

+ 

+ 

+ 

+  + 

NE/I 

+ 

+ 

+ 

+  + 

NWREL 

+ 

+ 

-  + 

RBS 

+ 

+ 

+  + 

S£DL 

+ 

+ 

+ 

SEIL 

+ 

+ 

o 

*NCREL 

is  on  a 

d  if f erent 

schedu 1 e 

and  no  separate  needs 

assessment  report  was  required  in   1987.     Proposal  for 
88-89  was  used. 
KEY:   +  =  method  useH  and  analysis  provided 

o  =  data  collected  but  no  analysis  oresented 


-  =  no  data  collected 
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All  labs  used  multiple  methods,  and  some  used  all.  This  kind 
of  profiling,  however,  is  not  very  adequate  because  it  masks  the 
fact  that  a  "  +  '•  in  the  table  for  one  lab  might  mean  a  cursory 
discussion  in  a  few  paragraphs  and  for  another  it  might  mean  a 
detailed  analysis   in  &  separately  bound  report. 

Surveys .  All  labs  except  SEIL  conducted  at  least  one  needs 
sensing  survey,  and  some  labs  conducted  two  or  three.  Virtually 
all  samples  were  purposive  rather  than  random.  In  some  cases  a 
single  group,  e.g.,  superintendents,  was  studied,  while  in  others 
many  different  groups  were  surveyed.  Response  rates  varied  from 
poor  to  mediocre.  Data  in  survey  format  were  also  collected  from 
members  of  advisory  committees  and  participants  in  conferences, 
workshops,  and  other  meetings. 

General ly,  the  procedure  was  to  ask  respondents  to  rank  or  rate 
items  from  a  list  of  possible  educational  problems.  In  at  least 
three  cases  (AEL,  NE/I ,  and  SEDL) ,  a  common  methodology  developed 
by  Grunig  was  employed.  This  involves  asking  for  each  item  whether 
the  respondent  (1)  ever  thinks  about  the  issue,  (2)  could  make  a 
difference,  and  (3)  is  connected  to  the  issue.  Although  a  great 
deal  is  made  of  the  fact  that  this  approach  is  based  on 
communications  theory,  that  cheory  is  not  explained  or  used  to 
provide  any  special  interpretation  of  the  data.  Indeed,  although 
it  seems  possible  that  the  three  items  might  form  a  scale,  no 
attempt  is  made  to  examine  the  interrelati  ons  of  t  he  three 
responses . 

Beyond  that ,   many  object  ions  have  been  ra  ised  to  us  ing  att  i  tude 
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surveys  for  measuring  needs  (Waks  1979).  Which  sense  of  "need"  is 
being  empl oyed?  Are  they  at ta inment  needs ,  process  needs  or 
resource  needs?  How  does  one  distinguish  between  needs  and  wants? 
How  does  one  weight   the  responses  of  different  stakeholders? 

Implicit  in  the  needs  assessment  approach  is  the  idea  that 
needs  can  be  prioritized  and  that  need  patterns  will  vary  from 
region  to  region  and  state  to  state.  Yet  many  of  the  issue 
statements  are  at  the  level  of  "improve  the  quality  of  teaching." 
But  surely  at  this  level,  which  is  the  level  of  the  major 
components  of  the  educational  enterprise,  every  lab  needs  to  have 
the  capability  of  providing  some  KP  or  KU  service.  The  need  to  set 
priorities  comes  only  at  lower  levels  of  specificity  where  choices 
must  be  made  among  lower  level  objectives — e.g.,  which  aspect  of 
teaching  quality  is  most  in  need  of  attention?  Further,  at  some 
point  the  choices  to  be  made  become  a  technical  issue  that  must  be 
based  on  the  best  evidence  f rom  research  and/or  experience  and  not 
on  attitudes  or  values.  To  summarize,  if  there  is  a  place  for  a 
survey  approach  to  needs  assessment,  it  needs  to  find  a  place 
between  the  broad  components  of  education  on  the  one  hand  and  the 
level   of  technical   design  on  the  other. 

Indicators .  All  labs  examine  a  variety  of  statistical 
indicators  to  demonstrate  their  understanding  of  their  regional 
context ,  including  economic ,  demographic ,  social ,  geographic ,  and 
educational   data  from  many  sources. 

Strategic  planning  1s  the  model  often  used  either  explicitly 
(McREL)  or     implicitly,   as  evidenced     by  the  frequent     reference  to 
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"environmental  scanning'1  as  the  type  of  analysis  employed.  The 
analyses  presented  vary  from  superficial  to  sophisticated.  McREL 
makes  a  plausible  case  on  the  basis  of  analysis  of  major  economic 
shifts  in  its  region  for  making  the  restructuring  of  education  its 
broadest  goal . 

Attainment  needs  in  Waks1  sense  are  identified  through  analysis 
of  NAEP  and  state  testing  data.  R8S  emphasized  this  type  of 
analysis  and  published  an  analysis  of  regional  test  results  for 
1978-86.  This  type  of  analysis  led  to  the  identification  of  At 
Risk  Youth  as  a  program  in  several  labs  and  as  a  cross-lab 
coordination  theme . 

Content  Analysis  of  Trends.  This  category  covers  several 
different  methodologies.  Several  labs,  including  AEL ,  McREL,  and 
NE/I,  employed  the  methodology  popularized  by  John  Naisbitt  1n 
Megatrends  (1982)  in  which  newspapers,  magazines,  professional 
journals,  and  newsletters  are  systematically  collected,  coded,  and 
placed  in  a  database.  This  category  also  encompasses  the  more 
traditional  scholarly  analysis  of  publications  such  as  needs 
assessment  reports  of  other  regional  or  national  organizations .  A 
review  of  major  national ,  educati onal  reform  reports  is  one  type 
(SEIL)  and  documentation  and  analysis  of  state  legislative  reform 
activity  is  another  . 

Documentation  of  Operations  >  Many  labs  have  devised  systems  of 
logs  and  reports  for  gathering  data  in  the  course  of  their  normal 
operations  that  .provide  grist  for  the  needs  assessment  mill  These 
include     logs     of     telephone     contacts,     records     of     requests  for 
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assistance,  telephone  and  mail  followups  of  participants  in 
conferences  and  workshops,  etc.  NE/I  devised  elaborate  systems  of 
this  kind,  perhaps  prompted  by  its  decentralized  structure;  its 
initial   system  proved  to  be  too  cumbersome  and  had  to  be  modified. 

Comments  on  Needs  Assessment .  The  above  section  has  described 
the  range  of  methods  used  by  1 abs  for  needs  assessment ,  but  it  has 
not  conveyed  the  considerable  range  in  the  depth  and  quality  of  the 
analysis . 

Regional  Capabil ities 
Federal  Specifications . 

The  RFP     requirements  for     studying  regional     capabilities  were 

lumped  with  some  others   1n  Subtask  1.2: 

Assess  regional  needs,  capabilities  and  opportunities 
and  establish  priorities  for  laboratory  activity  (p. 
19). 

In  addition,   it  was  noted  that 

...the  assessment  process  should  Include  a  census  and 
analysis  of  research  and  development  organizations  and 
the  service  Improvement  organizations  in  the  region  in 
terms  of  their  school   improvement  activity  (p  19). 

It     was  ey     ained     that   "Data     on  their     activities  are     crucial  to 

ident 1f ying       gaps       in       services     and       possibl e       partners  for 

collaboration  with  the  laboratory"   (p.  19). 

A  further  explication  of     the  rationale  behind  this  requirement 

is  provided  by  Clark  and  Carroll  (1980): 

Understanding  the  region  means  much  more  than 
identifying  regional  "needs"  however  they  are  defined. 
It     means  having     an     inventory  of     KP,     KU ,   and  school 
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Improvement  activities  al ready  underway  -  their 
strengths  and  weaknesses;  an  understanding  of  the 
incentives  and  disincentives  which  inf 1 uence  agencies 
and  actors  1n  the  KPU  community;  a  feel  for  new  or 
modified  activities  which  are  feasible  and  acceptable;  a  . 
sense  of  the  1ntr insically  interesting  needs  or  pr obi  ems 
1n  which  Individual  agencies  are  willing  to  invest  their 
resources   (p.  4-1). 

Nature  of  Data  Available 

In  strategic  planning  a  comparison  of  environmental  press 
(demand)  with  Institutional  capacities  (supply)  is  an  essential 
element  of  the  planning  process  (Steiner,  1979).  OERI  sought  to 
focus  on  this  type  of  analysis  by  requiring  a  separately  bound 
"needs  and  capability  assessment  report"  as  part  of  the 
continuation  proposal  for  the  third  through  fifth  years.  It  also 
required  a  statement  of  the  Tab's  own  organizational  capability  as 
part  of  the  technical  .^proposal  . 

The  assessment  of  regional  capabilities  was  the  most  poorly 
Implemented  component  of  the  planning  model.  Why  this  should  be  so 
1s  not  clear  given  the  fact  that  a  useful  model  for  maintaining  a 
database  on  Institutions  performing  RDD&E  or  policy  studies  had 
been  provided  a  few  years  earlier.  NIE  had  sponsored  a  universe 
survey  by  the  Bureau  of  Social  Science  Research  of  these 
organizations.  Its  conceptual  framework  and  methodology  had  been 
detailed  1n  the  final  report,  ARROE — American  Registry  of  Research 
and  Related  Organizations  1n  Education .  by  Joanne  Frankel ,  Laure 
Sharp  and  Albert  Blderman  (Frankel,  Sharp  and  Biderman,  1979), 
available  in  ERIC.  A  derivative  di  rectory  of  organizations  was 
published  by  FWL  (Lehmlng,  1982). 
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'I  here  appears  to  be  one  source  of  confusion  concerning  the 
purpose  of  a  regional  capabilities  assessment.  A  distinction  can 
be  made  between  KPU  capacity  for  internal  purposes  (  e.g.  the 
avaluation  unit  of  a  city  school  system)  and  as  a  service  for 
others  (e.g.  evaluation  contractors  in  the  private  sector).  Yet 
the  RFP  asked  only  for  a  census  of  service  providers,  and 
apparently  most  labs  limited  themselves  to  this  perspective.  Thus, 
for  example,  in  publishing  a  directory  of  educational  resource 
organizations,  RBS  eliminated  SEAs  and  LEAs  because  they  did  not 
offer  services  to  others.  (But  surely  SEAs  provide  services  to 
LEAs  even  if  they  aren't  Mfor  hire"  for  that  purpose).  No  doubt 
RBS's  services  to  the  Philadelphia  school  district  is  limited  by 
the  fact  that  they  have  a  considerable  capability  of  their  own. 
However,  in  negotiating  its  niche  in  the  regional  infrastructure,  a 
lab  must  know  whether  it  is  dealing  with  SEAs  and  LEAs  with  KPU 
abilities.  Perhaps  the  lab  distinguishes  between  the  information 
needed  for  its  own  purposes  and  that  which  would  be  useful  to 
others  in  a  published  directory,  but  the  analyses  in  the  planning 
documents  appear  to  be  limited  to  service  providers  and  ignore 
organizations  with  internal   capac ity  only . 

Another  purpose  of  the  resource  inventory  concerns  the  lab 
commitment  to  a  "with  and  through"  strategy.  Labs  need  to  identify 
other  organizations  they  can  work  with  and  the  type  of  relationship 
that  might  be  established.  In  this  context,  it  is  well  to 
recognize  that  some  of  these  organizations  may  be  in  competition 
with  the  lab.     Perhaps  this   is     the  reason  that  RBS  did  not  include 
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for  profit  agencies  1n  its  directory. 

Only  RBS  has  published  a  current  directory,  although  at  this 
writing  NE/I  has  one  in  press.  FWL  has  been  maintaining  such  a 
database  for  some  years,  but  "its  most  recent  directory  was 
published  in  1985.  However,  FWL  has  clearly  gone  the  farthest  over 
the  years  in  carefully  examining  regional  capabilities.  Indeed, 
their  report  shows  a  two-page  bibliography  of  laboratory  studies, 
other  regional  studies,  and  national  projects  that  provide  analyses 
of  the  educational  KPU  capabilities  of  all  kinds  of  institutional 
performers  and  of  interorganizational  networks.  FWL  would  be  in  a 
position  to  provide  leadership  to  new  labs  in  making  this  a  more 
realistic  aspect  of  their  planning. 

Several  other  labs  (McREL,  NWREL,  SEOL)  achieved  minimum 
compliance  with  this  RFP  requirement  by  providing  lists  of 
organizations  by  type,  state,  and  contact  person.  But  without 
information  on  areas  such  as  field  of  expertise,  type  of  KPU 
service,  primary  cl ients,  and  personnel ,  such  lists  are  of  limited 
planning  value.  Possibly  each  has  more  data  in  its  files  than  it 
includes  in  its  listing,  and  no  doubt  staff  have  personal  knowledge 
of  many  other  regional   organ izat i  ons . 

No  lab  provides  an  analysis  model  for  relating  capability  and 
needs  information.  SEDL  provides  an  "environmental  analysis"  based 
on  the  market  research  model  of  Philip  Kotler  that  contains  a 
discussion  of  market  environments  and  competitive  environments  and 
that  includes  a  discussion  of  intermediaries  ("vith  and  through" 
organizations)  and  agencies  offering     competing  services,   but   it  is 
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not  clear  what  data  they  are  working  from. 

Other  labs  sought  to  finesse  this  requirement  by  including  one 
or  more  items  in  surveys  of  clients  or  constituents  that  asked 
about  sources  of  hel p  for  different  kinds  of  or obi  ems ,  or  about 
opinions  of  the  most  appropriate  roles  for  the  regional  laboratory. 
But  this  methodology  may  overlook  some  potential  resources,  and 
there  are  obvious  difficulties  in  relying  on  second-hand 
information . 

Comparison  of  Lab  Regions 

So  far  we  have  been  discussing  the  collection  and  use  of  new 
Information  on  regional  KPU  capacity.  At  <~he  time  the  current  lab 
programs  were  being  planned,  data  on  educat.jnal  KPU  organizational 
capacity  were  available  by  state  and  region  (Frankel  et  al  1979). 
A  crude  comparison  of  the  nine  regions  is  shown  in  Table  3,  which 
displays  the  percentage  distribution  of  four  kinds  of  KPU 
organization  across  regions,  along  with  the  distribution  of 
popul at ion  and  OERI  funds . 

Clearly  the  distribution  of  KPU  organizations  of  all  kinds 
closely  follows  the  distribution  of  enrollment.  There  is  more 
variability  in  the  profiles  of  specific  kinds  of  organizations. 

The  interpretation  of  these  data  is  complicated  by  another 
consideration.  Some  service  needs  are  enrollment  dependent  and 
some  are  not.  For  example,  if  all  the  teachers  of  a  certain  type 
need  a  kind  of  retraining,  then  the  size  of  the  task  depends  on  the 
number  of  teachers.  But  the  amount  of  effort  required  to  conduct  a 
state  policy  analysis  may  not  differ  greatly  1n  a  small   state  and  a 
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Table  3.  Percentage  Distribution  of  Educational  KPU  Organizational 
Resources,  Pub! ic/Pr ivate  Enrollment,  and  OERI   Funds,   by  Lab/Region. 


 Ed  KPU  Organizations**   FY  1  987  Pub/Pvt 

Lab  Small     Large  OERI  Enroll- 


Publ ic 

Publ 1o 

Pvt 

Academic 

Total 

Funds 

ment 

AEL 

5 

4 

4 

6 

5 

9 

7 

FWL 

19 

7 

1  3 

10 

12 

14 

1  2 

McREL 

5 

9 

8 

8 

7 

8 

6 

NCREL 

24 

18 

14 

26 

23 

8 

22 

NE/I 

14 

9 

26 

1  6 

1  7 

11 

1  5 

NWREL* 

6 

7 

3 

5 

5 

17 

4 

R8S 

9 

13 

22 

9 

12 

14 

1  0 

SEDL 

9 

13 

4 

7 

7 

9 

1  1 

SEIL 

9 

21 

6 

1  3 

1  1 

9 

1  3 

Total 

100% 

101% 

1  00% 

100% 

99% 

99% 

100% 

Number 

537 

149 

478 

1  ,268 

2,432 

$16,975K 

46  ,988K 

*Does  not  include  Pacific  Territories 

U  Educational   KPU  organizations  typology; 

Small   public:    ISAs  and  LEAs  with  enrollments  of  10,000-49,999 

Large  public:  SEAs  and  LEAs  with  enrollments  of  50,000  or  more 

Academic:   institutions  of  higher  education 

Private :   res i dual  category 
Source  cf  organization  data:   Frankel,  Sharp,   and  Biderman,  1979, 

Appendix  F.     Detail  may  not  add  to  total   because  of  rounding. 

large  one. 

The  table  also  shows  the  distribution  of  1987  OERI  funds.  We 
can  begin  to  see  here  why  defining  an  equitable  distribution  of 
these  funds  is  so  difficult.  One  might  argue  that  funds  should 
follow  the  distribution  of  population  or  enrollment.  However,  some 
allowance  seems  to  be  necessary  for  factors  such  as  different 
numbers  of  states  in  a  region  and  the  logistics  problems  found  in 
regions  with  large  land  areas  and  dispersed  populations.  On  the 
other  hand ,  if  the  existence  of  other  KPU  organ izat ional  resources 
is  taken  into  account ,  some  ki nd  of  compensatory  f ormul a  seems 
appropriate ,    i.e.,     more  funds     shou  Id  go     to  reg  ions     with  sma  Her 
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regional  capaci  ty .  Another  consideration  that  came  into  play  was 
the  fact  some  labs  are  in  a  developmental  stage  while  others  are 
operational.  No  precise  formula  was  ever  worked  out.  The  actual 
distribution  apparently  reflects  some  intuitive  balancing  of  the 
above  factors,  plus  one  other :  a  hold  harml ess  provision  that 
enabled  previously  existing  labs  to  receive  no  less  than  their 
previous  al 1 ocat  ion  (conversation  wi  th  David  Mack) . 

Sel f -Assessment 

Federal     Specifications . 

It     is     useful     to     approach  the     sel f -assessment     function  by 

reviewing     some  chronology.       The     RFP  identified     sel f -assessement 

(SA)     as  a     sub-task  of     Task  1,     placing  it     within  the  strategic 

planning  cycle  where  five  objectives  were  listed: 

o  Assuring  that  work  performed  meets  appropriate 
standards  for  quality  and  efficiency 

o  Assuring  that  the  laboratory  carries  out  the 
mission , functions  and  purposes  for  laboratories 

o  Using  evaluation  information  as  a  basis  for  planning 
adjustments ,  foil ow-on  act ivi  ties ,  and  new 
initiatives 

o  Making  staff  evaluations 

o  Contributing  to  knowledge  about  effective  strategies 
for  improving  education  through  careful ly  designed 
studies  of  how  its  own  dissemination  and  improvement 
efforts  are  working . 

This  is  quite  a  diverse  set  of  purposes !  The  first  three 
purposes  clearly  belong  in  the  planning  cycle.  However,  the  use  of 
data     to  make     staff     evaluations  concerns     a  different  management 
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function.     And     the  last   is  not     a  management  function  at     all,  but 


purposes  together  1t  1s  that  of  using  information  to  renew  and 
Improve  the  functioning  of   the  organization. 

An  annual  SA  report  was  required.  Apparently  some  confusion 
existed  about  what  was  to  be  Included  in  the  report,  and  toward  the 
end  of  the  first  year  the  contracting  officer  issued  guidelines 
covering  both  the  format  and  content  of  the  report  (Wormwood, 
1986).  Broadly,  the  report  was  to  include  an  abstract,  the  design 
of  the  self -assessment ,   results,   and  use. 

The  reports  submitted  f  or  the  first  contract  year  varied  in 
content,  quality,  and  detail.  NCREL,  which  had  been  funded  on  a 
different  cycle  and  operated  under  different  req» •  - remen ts ,  did  not 
submit  a  ruport.  Some  labs  simply  listed  all  their  activities  and 
sub-activities  and  reported  on  whe:ner  each  had  been  completed. 
Some  were  short  sub-sections  of  the  annual  report.  In  other  cases, 
they  were  longer ,  consist  ing  most  1 y  of  a  rehash  of  SA  des  ign , 
either  as  described  in  the  proposal  or  subsequently  modified.  Some 
submi  tted  <e  raw  data  from  cl ient  surveys ,  exit  interviews  from 
workshops ,  and  the  1 i  ke ,  1n  mind-numbing  de  ail.  A  few  suppl ied 
reports  that  wers  reasonably  thoughtful  in  coverage  of  at  least 
some  of  the  suggested  evaluation  questions ,  but  appear  more 
judgmental  than  e  m pi  r ical  .  Under  these  c  i  rcumstances ,  an  anal ys is 
of  the  first  year  reports  probably  would  not   be  very  fruitful. 

It  also  became     clear  that,    in  addition  to     playing  an  internal 
role   in  each  lab's  planning  and  management  system,   SA  was  viewed  as 


rather     is     a  research  objective. 


If     one     goal   ties     al 1  these 
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part  of  the  OERI  effort  to  evaluate  the  Laboratory  Program.  A 
consultant,  Jerry  P.  Walker,  was  engaged  to  visit  every  lab  to 
examine  its  evaluaMon-related  activities  and  to  elicit  the  views 
of  lab  personnel  concerning  OERI  evaluation  plans.  It  was  during 
the  second  ye^r  that  plans  for  the  1988-90  fiscal  years  had  to  be 
prepared,  at  which  point  the  1986  SAs  were  available,  but  those  for 
1987  were  not.  Each  lab  was  visited  by  a  site  review  team  as  part 
of  tnat  process. 

No  new  quidelines  were  prepared  for  the  1987  SA  report,  but  in 
December  1987  Charles  Stalford,  who  was  in  charge  of  the  0Er I 
evaluation  effort,  confirmed  that  the  Wormwood  guidelines  were 
still  in  effect  and  suggested  some  additional  questions  that  might 
be  addressed  (Stalford,  1987).  These  emphasized  the  use  made  of  SA 
by  the  governing  board,  an  analysis  of  the  strengths  and 
limitations  of  the  lab's  capacity  for  SA,  and  identification  of  the 
activities  and  products  that  the  lab  considered  the  most  productive 
and  why.  Particular  interest  was  expressed  in  knowledge  coming  out 
cf  SA  activities  that  might  begin  to  yield  generalizations  about 
the  strategies  that  worked  best. 

OERI  also  prepared  an  Evaluation  Plan  f  gi  1987-90 ,  which  stated 
that  the  tnree  components  of  the  evaluation  plan  for  regional 
educational  laboratories  were  sel f -assessment ,  performance 
evaljation,  and  program  evaluation.  Labs  we,«e  urger1  to  report 
their  shortcomings  and  strengths  canaidly,  trusting  that  "While 
OER I  has  access  to  such  reports  as  'deli  verabl es , T  the  Agency 
understands     their   s in -process T     nature     and     will   therefore  treat 
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information  in  them  carefully"  (OERI,  1987,  p.  5).  Further,  the 
idea  of  collecting  uniform  types  of  SA  data  across  labs  was 
disavowed.  Although  no  additional  specific  guidelines  were 
provided  for  SA,  the  following  six  questions  were  listed  as  guiding 
the  overall  evaluation,  and  were  cited  in  some  of  the  1987  SA 
reports ; 

o  What  is  the  evidence  that  the  laboratory  has  had  a 
positive  effect  on  educational  practice  wi  thin  its 
reg  ion? 

o  Are  laboratory  products  and  activities  well  received 
by  educators  and  state- level  decisionmakers? 

o  Does  the  laboratory  have  productive  working  partner- 
ships with  organizations  in  its  region  whose 
cooperation  is  required  to  accomplish  mutual 
objectives? 

o  Are  the  laboratory  costs  consistent  with  those  of 
other  labs  for  similar  types  of  activities? 

o  Are  constituent  individuals  and  organizations  in  the 
region  aware  of  the  laboratory,  its  program  and  its 
products? 

,  o  Are  the  laboratory's  products     and  activities  of  high 
qual i ty? 

Whi 1 e  there  is  considerabl e  overl ap  with  other  statements  of 
evaluation  objectives,  there  are  a  couple  of  new  ones.  The  focus 
on  lab  visibility  is  new  (but  probably  a  very  weak  indicator).  The 
focus  on  cost  efficiency  has  been  adapted  to  an  intra-lab  context 
by  some  labs.  "^he  most  interesting  addition  is  the  focus  on 
establishing  "productive  working  partnerships,"  which  seems  to  be 
an  important  indicator  of  success  with  the  "with  and  through" 
strategy.  The  present  descriptive  synthesis  report  is  one  of  three 
components  of  program  evaluation   in  the  OERI  plan. 
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The  analysis  in  this  section  is  based  lorqely  on  the  1987 
self-assessment  reports.  (Again,  NCRE-,  which  was  funded  out  of 
cycle,  was  not  required  to  submit  this  report.  It  did  provide  some 
sel f -assessment  information  in  its  plan  for  1988-89.)  Designs  that 
were  descri  bed  in  the  proposals  often  proved  to  be  too  ambitious  to 
accomplish,  and  as  a  consequence  19  87  sel f -assessment  efforts  often 
contain  revised  designs,  diminished  results,  or  both.  Some 
contract  compliance  data  come  from  annual  reports.  There  is  a 
tendency  to  duplicate  information  in  the  annual  reports,  needs 
assessment  reports,  and  sel f -assessment  reports,  and  OERI  would  do 
well  to  sort  out  what  kinds  of  information  should  go  into  each. 
Problems  of  Analysis 

We  have     seen  that  the  objectives     for  SA  are  diverse.        In  its 
broadest  sense,   SA  encompasses  the     entire  management  system  of  the 


decision  making,  the  allocation  of  responsibilities  among  positions 
and  units  for  collect  ion  and  review  of  information,  the  substance 
of  the  information  collected,  and  the  resultant  actions  taken.  The 
technology  required  just  for  information  collected  is  so  extensive 
and  complex  it  is  almost  impossible  to  summarize.  For  example,  AEL 
lists  18  sources  of  evaluation  information  and  29  forms  of 
documentation  for  12  " generic"  act ivi  ties  or  products .  Al though 
not  all  kinds  of  information  are  collected  for  every  activity  or 
product ,  there  are  191  information/product  combinations.  RBS 
identified  15  kinds  of  products  and  13  kinds  of  activities  to  be 
evaluated.       While     other  labs     have     not     provided  as     complete  a 


lab,     including  the 


action     of     all      information  required  for 
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documentation  of  what  1s  Involved,  this  kind  of  detail  is  probably 
not  atypical . 

The  use  of  much  of  this  information  is  embedded  in  day  to  day 
lab  operations .  It  ^  s  the  stuff  of  weekly  staff  meetings  at 
project,  program,  and  institutional  levels.  Some  of  this  gets 
aggregated  to  quarterly  reports,  annual  reports,  and  SA  reports 
(sometimes  in  too  much  detail),  but  much  does  not.  Summarizing  it 
all  would  serve  no  useful  purpose.  The  challenge  becomes  one  of 
sorting  out  the  wheat  from  the  chaff.  Some  labs  seem  hard  pressed 
to  find  a  middle  ground  between  presenting  raw,  uninterpreted  data, 
on  the  one  hand,  or  presenting  judgments  and  assessments,  often  of 
some  interest,   but  without  underlying  evidence  on  the  other. 

For  present  purposes  we  have  the  problem  of  differences  between 
designs  and  reports.  Some  of  the  SA  designs,  usually  found  in  the 
original  proposals  but  sometimes  revised  in  later  documents,  appear 
comprehensive  and  sophisticated;  but  they  are  not  always  feasible, 
and  both  new  and  old  labs  have  had  to  rethink  and  revise.  And 
always  there  is  the  nagging  question  whether  overemphasis  on  SA  may 
not  amount  to  stopping  the  train  to  blow  the  whistle.  Cne  way  of 
coping  with  this  problem  has  been  to  take  the  position  that  not  all 
aspects  of  a  comprehensive  design  need  be  implemented  every  year; 
rather ,  each  year  Ts  SA  report  should  focus  on  a  few  appropriate 
components .  Using  this  rationale,  most  1 abs  have  chosen  to  delay 
focusing  on  the  difficult  task  of  measuring  impact  until  the  last 
year  or  two  of   the  current  five-year  contract. 

Another     problem     is     that     of  distinguishing     between     ad  hoc 
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information  and  general  knowledge.  Both  are  needed,  but  it  is 
important  to  distinguish  between  them.  For  example,  data  on 
whether  lab  constituents  are  aware  of  and  value  the  lab  is  ad  hoc 
information,  but  it  is  useful  for  formative  evaluation  purposes  and 
in  determining  whether  the  lab  is  meeting  certain  account a bi 1 i  ty 
objectives .  Data  on  whether  a  particular  lab  strategy  is  1 i  kely  to 
lead  to  lab  visibility  and  acceptance  may  be  the  beginning  of 
building  a  knowledge  base  on  which  strategies  are  more  effective 
under  given  conditions.  Every  lab  is  expected  to  spend  some 
portion  of  its  SA  energy  in  contributing  to  general  knowledge  of 
this  kind   (see  RFP). 

Sel f -Assessment  Designs  and  Mechanisms 

The  analysis  of  SA  is  composed  of  lab  profiles  on  the  evaluation 
questions  addressed,  ..the  assessment  models  or  images  invoked,  and 
the  mechanisms  used  to  implement  the  design.  The  data  are  found  in 
Tables  4  and  5.  While  ideally  a  tabulation  would  have  been  made 
linking  types  of  data  collection  and  other  mechanisms  with 
eval ua t i  on  questions,  the  necessary  data  were  not  a 1  ways  ava  i 1 abl e . 
However ,  examples  and  i  mpress  i  on  i  st  ic  s  ta temen  ts  about  these 
connections  appear  below. 

A  review  of  potential  evaluation  questions  in  the  various 
sources  mentioned  in  the  "Federal  Specifications"  section  above  and 
from  the  lab  designs  yields  a  considerable  list.  The  several 
sources  are  not  consistent,  and  there  is  no  implication  that  all 
are  appl icable . 

It   is  useful   to  distinguish     two  kinds  of  evaluation  questions. 
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Table  4.     Design  Features  of   FY   1987  Se 1 f -Assessments 


Des  ign 

Feature  AEL 

FWL 

ft 

McREL 

NCREL 

NE/I 

## 
NWREL 

RBS 

SEDL 

SEI  L 

I.   EVALUATION  QUESTIONS 

Criterion  questions 

A.   NEED  STRATEGY 

1  .    Re  1 evance 

R 

R 

R 

R 

R 

R 

R 

R 

6 .    IMPROVEMENT  STRATEGY 

2.  Quality 

Q 

Q 

Q 

Q 

Q 

0 

Q 

3.  Utility 

u 

u 

u 

u 

u 

u 

4.    Imoact/ef f ect 

I 

I 

I 

I 

i 

I 

I 

I 

5.  Client  satisfa 

s 

s 

s 

s 

s 

s 

s 

C.    INTERORGAN IZATIONAL  ! 

STRATEGY 

6.    I/O  arrangements 

10 

10 

10 

10 

7.   Reach  audience 

A 

A 

A 

A 

A 

8.   Lab  visibility 

V 

V 

V 

D.   ORG/MGMT  STRATEGY 

** 

9.  Effldancy 

E 

E 

10.   Capac  for  SA 

C 

c 

c 

Purpose  questions 

1 1 .    Improve  program 

P 

P 

P 

p 

P 

p 

12.    Improve  org/mgmt 

0M 

OM 

OM 

OM 

13.    Improve  SA 

SA 

SA 

SA 

SA 

SA 

SA 

SA 

14.   Staff  develop 

SD 

SD 

15.  Compliance 

C 

C 

C 

C 

16.  Knowledge 

K 

K 

K 

K 

II.  MODEL/IMAGE 

1.   Systems/C I PP* 

SY 

CIPP* 

2.   Quality  contro 

QC 

QC 

QC 

QC 

QC 

3.   Strategic  plan 

SP 

SP 

4.   Goal-free  eval 

GF 

GF 

5.    Instit  renewal 

IR 

IR 

IR 

IR 

*Con text ,    Input,   Process,   and  Product  mode 

**NWREL  addresses  several   org/mgmt  issues  dealing  with  its  full   range  of 
contracts,   but  this   is  beyond  the  range  of  this  OERI   self  assessment. 

n  McREL  data  from   1986  SA  report.      Final    1987  SA  report  not  available. 

ttltThe  NWREL  SA  report  deals  with  their   193  contracts  of  which  the  OERI 
contract  provides  4  9% 
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Those  in  the  first  group  focus  on  a  criterion  of  success,  such  as 
relevance  or  efficiency,  10  of  which  have  been  identified.  Those 
in  the  second  group  of  six  deal  with  the  purpose  or  use  to  be  made 
of  the  SA  and  are  concerned  mostly  with  various  kinds  of  desired 
improvements ;  improvements  to  the  lab  program,  to  lab  organ  izat  ion 
and  management,  to  SA,  etc.  Within  limits,  given  criterion 
measures  might   be  used  for  different  purposes. 

Further  examination  of  the  criterion  questions  reveals  that 
most  of  them  can  be  related  to  the  three  dimensions  of  our  strategy 
cube  (see  Chapter  I),  plus  two  dealing  with  organization  and 
management  at  a  more  general  level.  In  Table  4  the  evaluation 
questions  have  been  classified  as  criterion  or  purpose  questions, 
with  the  criterion  questions  further  subdivided  into  the  strategy 
or  management  dimensions  to  which  they  are  related. 

Evaluation  Questions  for  Educational  Need .  The  first  strategic 
dimension  deals  with  educational  need  or  policy  interest. 
Relevance  is  a  criterion  that  addresses  this  strategic  dimension 
and  ties  the  SA  back  to  needs  assessment.  It  asks  in  the  SA 
context  whether  the  lab  is  continuing  to  support  programs  that  are 
directed  toward  the  needs  of  the  region.  Although  not  all  labs  are 
shown  as  highlighting  this  criterion  in  their  1987  SA  reports, 
probably  all  do  so  either  in  their  needs  assessment  reports  or  in 
their  thres  to  five-year  plans.  Those  shown  in  the  table  have  a 
formal  method  of  classifying  areas  of  program  focus  and  matching 
these  against  needs  profiles. 

Evaluation  Questions  for  the  Improvement  Strategy.     A  numbar  of 
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the  other  criterion  evaluation  questions,  such  as  quality  and 
efficiency,  might  be  applied  to  either  the  improvement  strategy  or 
the  Interorganizational  strategy.  They  are  classified  the  way  they 
ore  in  Table  4  because  this  is  the  way  they  seem  to  have  been 
interpreted  by  most  of  the  labs.  (NWREL  addresses  both  the  focus 
and  quality  of  each  of  its  five  institutional  functions,  which  are 
at  the  level  of  our  strategies) .  It  might  be  useful  for  the  labs 
to  go  back  and  ask  if  some  evaluation  questions  might  be  appl ied  to 
both  strategies  (e.g.,  the  quality,  effectiveness,  and  impact  of 
both  improvement  and   interorganizational  activities). 

The  improvement  strategy  is  represented  by  several  evaluation 
questions.  Seven  of  the  labs  have  instituted  qua! i  ty  assurance 
systems  (internal,  external,  or  both).  (No  doubt  the  other,  two 
have  at  least  an  internal  editing  review,  but  the  SA  reports  do  not 
mention  a  qual i  ty  control  function. )  Th9y  range  from  routine 
editorial  review  to  internal  and/or  external  technical  peer  review 
of  papers  and  products.  Some  labs  engage  their  boards  and/or  their 
advisory  committees  in  the  process.  Data  are  collected  in  a  wide 
variety  of  ways,  including  surveys  of  users,  feedback  forms 
col  1  ected  after  forums  and  workshops,  and  evaluation  research 
conducted  either  by  lab  staff  or  subcontractors.  Quality  is 
assessed  through  judgments  based  on  implicit  or  explicit  technical 
or  professional   standards  and  is  conceptually  distinct  from  impact. 

Ut i 1 1 ty  is  a  more  complex  concept  than  it  may  appear  at  first. 
It  is  most  commonly  measured  by  asking  clients  whether  they  find  a 
product     or  service     to  be     useful.     But     is  this     an  opinion     or  a 
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judgment  based  on  use?  Examination  of  SA  reports  reveal s  the t  the 
data  cited  often  represent  judgments  of  potential  usefulness ,  but 
as  an  opinion  it  overlaps  with  cl ient  satisfaction,  which  we  have 
shown  as  a  separate  criterion.  No  labs  seem  to  have  identified 
utilization  as  a  criterion  in  their  design,  although  at  least  two 
actually  study  patterns  of  utilization  by  primary  and  secondary 
clients  through  tracer  studies  (AEL  and  SEIL).  Being  useful  also 
implies  something  about  impact  or  effectiveness ,  another  criterion. 
It  seems  to  me  that  the  most  analytically  distinct  concepts  are 
use,  client  satisfaction,  and  impact,  and  that  utility  is  some 
murky  combination  of  the  three. 

Impact ,  sometimes  termed  "effectiveness , "  would  seem  to  be  the 
ultimate  criterion  for  lab  assessment,  but  this  is  one  of  the  most 
controversial  issues  in  the  laboratory  program,  with  respect  to 
both  self-assessment  <?nd  OERI  evaluation.  One  problem  is  the 
difficulty  in  distinguishing  lab  impact  from  other  influences. 
This  problem  is  compounded  by  the  fact  that  OERI,  in  attempting  to 
leverage  its  scarce  resources,  has  mandated  the  "with  and  through" 
or  indirect  strategy,  yet  seems  to  demand  evidence  of  impact  at  the 
classroom  level .  At  the  same  time,  education  is  acknowledged  to  be 
a  loosely  coupled  system  or  configuration  (see  Chapter  I  above)  in 
which  ideas  and  products  do  not  flow  smoothly  from  one  organization 
or  position  to  another. 

It  may  be  helpful  to  give  some  examples  of  impact  data 
collected  by  labs  in  FY  1987.  As  mentioned  earlier,  there  is  a 
general  f eel ing  that   it  will     be  more  appropriate  to  measure  impact 
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toward  the  end  of  the  five-year  contract  period.  Nevertheless, 
some  impact  data  relating  to  the  improvement  strategy  are 
presented,  which  in  many  cases  tend  to  be  simple  counts  coming  out 
of  documentation  systems ,  such  as  the  number  of  documents 
distributed,  the  number  of  conference  participants,  etc.  Such 
indicators  tend  to  fall  considerably  short  of  measuring  educational 
improvement;  they  are  closer  to  being  a  measure  of  effort  or 
ac t i vi ty . 

Other  assessments  come     closer  to  the  mark.       RBS,   for  example, 

has  staff     identify  the  type     of  impact     that  can  be     expected  from 

each  project  or  activity  and  then     asks  clients  to  rate  the  product 

or  activity  on     those  impact  criteria.     The     potential    impact  areas 

are  (RBS  Self -Assessment  Report,   FY  87,   p.  81): 

o   Increase  awareness   in  particular  area 

o  Provide  input  for  decisionmaking 

o   Increase  networking  or  collaboration 

o  Provide  products  and  materials 

o   Improve  organizational  climate 

o  Improve  planning,   administration  and  management 

o   Improve  classroom  teaching 

o   Increase  staff  capability  in  other  areas 

o   Improve  instructional  resources 

o   Increase  student  learning 

o   Increase  pa rent a  1   involvement   in  school s 

It  should  be  noted  that  these  are  client  ratings  and  not  direct 
measures  of  impact.  Note  also  that  all  of  these  except  one 
("increase  networking  or  coll aborat ion " )  are  indicators  of  the 
impact  of  the  improvement  strategy,  not  the  linkage  strategy.  They 
seem  to  be  a  mixture  of  proximate  and  more  ultimate  impact 
indicators .  (The  "provide"  i  terns  may  not  be  measures  of  impact  at 
all  .) 
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More  di  rect  measures  can  be  found  in  tracer  studies  and  special 
studies,  which  gener  "My  means  an  evaluation  research  project 
directed  at  a  specific  project  or  product.  Both  AEL  and  SEIL  had 
their  self-assessment  subcontractor  use  a  tracer  methodology  to 
study  the  spread  and  use  of  lab  products. 

NWREL     is  testing     a  conceptual     framework  that     posits   -i  six- 
stage  continuum  of   impact  as  follows: 
o  User  satisfaction 

o  Acquisition  of  knowledge  and  skills 

o  Use  in  planning 

o  Use  in   impl emen tat i on 

o  Indi  rect  outcomes 

o  Direct  outcomes 

Note  that  this  framework  defines  user  satisfaction,  which  we 
had  listed  as  a  separate  criterion,  as  stage  one  of  impact.  This 
schema  was  tested  in  ;a  case  study  of  evaluation  by  NWREL'S  Center 
for  Performance  Assessment  and  appears   to  hold  promise. 

While  all  labs  express  their  desire  to  measure  impact  and 
provide  some  data  that  are  at  least  proxies,  they  approach  the 
issue  with  understandable  caution.  Given  the  problems  of  multiple 
causation  in  social  phenomena,  the  methodological  and  theoretical 
tasks  of  screening  out  other  influences  to  measure  lab  impact , 
especially  more  distal  impacts ,  are  considerable  if  not 
i  nsurmountabl e . 

We     have     lifted     cl  ient     satisfaction     as     another  evaluat--^ 
question  because  it     has  been   identified  separately  in     some  of  the 
suggested  guidelines,   but,   as  noted   in   the  NWREL  scale,    it  can  also 
be  considered  as  one  of  the  types  of   impact .     Ques t ionnai re  surveys 
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and  telephone     interviews  are  used     by  a     number  of  labs     to  elicit 

expressions  of  satisfaction. 

Evaluation  Questions     for.  the     Linkage  Strategy,       Although  the 

development     of  appropriate     1 inkage     strategies ,    particularly  for 

working  "with     and  through"   other  regional     organizations,   has  been 

identified     as     one     of     the  cornerstones     of     lab     operation,  the 

specification  of     related  evaluation  questions  has     been  relatively 

weak.     The  one  most  on  target     appears  not   in  the  RFP  discussion  of 

SA  but  as  one  of  six  questions  posed  by  the  OERI  evaluation: 

Does  the  laboratory  have  productive  working  partnerships 
wi  th  organizations  in  i  ts  region  whose  cooperation 
is  required  to  accomplish  mutual  objectives? 

Even  this  question  is  somewhat  linited  in  that  partnerships  is 
only  one  mode,  of  relationship,  althougn  it  might  be  interpreted  in 
a  more  generic  sense.  Several  labs  do  list  the  organizations  they 
work  with  and  the  networks  they  have  helped  to  form,  but  the 
quality  of  those  relationships  is  often  difficult  to  judge.  In 
Table  4  we  have  used  the  more  generic  term  " in+~er organizational 
arrangements'1  to  include  all  evaluation  questions  that  focus  on  the 
establ ishment  of  effective  partnershi  ps ,  coll  a bora t ions ,  networks 
or  other  working  relationships.  Only  four  labs  seem  to  have  such  a 
focus   (FWL,   NE/I,   NWREL,   and  RBS). 

NE/I  shows  an  explicit  concern  with  assessment  of  the  linkage 
strategy.  This  emerges  as  a  second  tier  of  evaluation  questions 
appearing  under  the  heading  of  laboratory  effectiveness  and  impact: 

within  the  framework  of  [the  five  overarching  goals  that 
frame  and  structure     the  work  of  the     lab],    impact  within 
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the  reg 1on  can  be  thought  of  as  successful  1 y  devel opi ng 
linkages;  serving  as  a  clearinghouse  of  improvement 
resources  and  knowl edge ;  Infusing  knowl edge  from  the 
research  and  devel opment  community  Into  reg  ion a  1 
activity;  Implementing  dissemination  and  assistance 
activities;  and  supporting  school  improvement  efforts . 
(NE/I  Year  2  Sel f -Assessment  Report ,   p .  16). 

These  questions  are  then  addressed  unden  the  following  headings  of 
the  report   ( 1b1d ,    pp.  16-20): 

o  Convening,  facilitating,   and  empowering 

o  Increasing  capacity 

o  Broaden 1ng  per s pec t 1 ves 

o  Disseminating  and  promoting  research 

NWREL  Identifies     an   "Institutional   function"     that  corresponds 

to     the     linkage     strategy:     "To  what     extent     does     NWREL  promote 

communications  and  linkages  among     constituents  and  policy  makers?" 

The     focus  question     is,    "Does     NWREL  encourage     an  exchange  among 

regional   networks     of  ..const  1  tuents?"   This  question     is  addressed  in 

relation  to  five  "categories  of  networks": 

o  NWREL T  c  Board  of  Directors  Program  Committee 
o  Program  policy  boards 

o  Advisory  committees  for  NWREL ' s  areas  of  emphasis 
o  Special   target  populations 

o  School   improvement  organizations  throughout  the  reg  ion 

The  quality  question  1s,  "Has  NWREL  enhanced  the  leadership  capa- 
bilities and  linkages  of  Its  constituents?"  The  lab  suggests  the 
possibility  of  applying  the  impact  continuum  mentioned  above  to 
this  question . 

Two  other  evaluation  questions  relating   to  the  linkage  strategy 

appear  1n  several   forms  and  deal   with  client  contact  and  awareness: 

o  Are     lab     products     and     services     reaching  intended 
audiences? 
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o  Are  constituent  individuals  and  organizations  in  the 
regi  on  aware  of  t  he  1  abor  atory ,  its  program ,  and  Hs 
products? 

"The  second  of  these  is  a  bit  of  a  sore  point  because  of  the 
"with  and  through"  strategy.  It  is  difficult  to  maintain  lab 
visibility  for  products  and  services  that  are  usually  provided  by 
an  intermediary.  This  may  be  one  reason  that  Most  labs  try  to 
retain  some  element  of  direct  service.  Only  s  few  labs  address 
these  questions. 

Evaluation  Questions  fop  Orqa nizat ion/Mdnaqement .  The  fourth 
type  of  criterion  question  concerns  measures  of  management 
performance  that  are  more  general  1n  nature  and  not  tied  to  lab 
mission.     Two  have  been  identified. 

Efficiency .  a  common  managerial  standard,  is  difficult  to 
measure  in  the  lab  context.  Even  though  it  is  identified  as  a 
criterion  in  the  RFP,  no  lab  has  actually  attempted  to  measure  it. 
RBS  includes  it  in  its  design  but  has  postponed  measuring  it  until 
1988.  They  define  efficiency  in  terms  of  "whether  [the] 
laboratory's  programs,  services,  and  produ  ts  are  performed  in  [a] 
cost-conscious  manner  with  [a]  minimum  of  waste  and  duplication  of 
effort"  (FY  1987  Self  Assessment  Report ,  ^  A-2) .  This 
determination  is  made  by  the  Executive  Director  and  the 
Institutional  Review  Team  by  reviewing  the  laboratory's  management 
system*?,  )ro^  ^t  plans,  and  project  data  base.  To  develop  some 
mearures  of  efficiency  that  could  be  used  for  cross-lab  comparisons 
might  require  thtt  CC'U  sponsor  a  special   R&D  project. 

Thfc  second  managerial   criterion  concerns  the  lab's  capacity  for 
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conducting  self -assessment . 


This  criterion     is  mentioned     only  in 


the  OERI  evaluation  plan  as  a  possible  optional  SA  issue.  Four 
labs  provide  a  discussion  of  their  SA  capaci ty ,  and ,  as  we  shal  1 
see  below,  a  number  have  a  goal  of  using  the  SA  process  to  improve 
their  SA  system.  To*  obtain  a  third-party  perspective  on  their  SA 
efforts  AEL  and  SEIL  employ  external  evaluation  contractors  and  FWL 
and  NWREL  engage  external  advisory  panels.  Both  McREL  and  SEDL 
used  reports  of  OERI  site  review  teams  to  modify  their  SA  systems. 
Perhaps  some  kind  of  measure  of  capacity  could  be  derived  from  a 
consideration  of  the  mechanisms  employed. 
Purpose  Questions 

The  other  major  type  of  evaluation  questicn  we  have  termed 
"purpose  questions  "  Each  identifies  a  purpose  to  be  served  without 
specifying  the  criteria  to  be  employed.  The  other  side  of  the 
purpose  "coin"  is  the  use  to  be  made  of  the  SA  data.  In  some  cases 
the  data  from  criterion  questions  can  be  used,  but  in  others 
additional  measures  would  need  to  be  identified.  The  data  in  Table 
5  represent  a  mixture  of  stating  the  purpose  in  the  evaluation 
design  and  citing  examples  of  the  use  made  of  SA  data. 

Improve  Lab  Programs .  The  improvement  of  lab  functioning  is 
probably  the  central  purpose  of  SA .  This  purpose  is  served  at 
project,  program,  and  institutional  levels  and  includes  both  the 
fine-tuning  of  current  work  and  the  planning  of  future  wor k .  For 
the  most  part  the  use  of  documentation  and  evaluation  data 
concarning  sH^cific  projects  and  activities  for  the  formative 
evaluation/improvement  of  products  and     services   is  too  detailed  to 
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be  reported.  Most  of  this  occurs  at  and  is  the  responsibility  of 
lower  echelons  and  is  part  of  day-to-day  operations.  Some  labs 
report  this  kind  of  detail,  while  others  prefer  summaries  and 
interpretations  based  on  it.  At  the  program  and  institutional 
levels  labs  use  SA  findings  to  continue,  discontinue,  restructure, 
and  pi  an  programs ,  reorganize  the  structure ,  and  change  strategies. 
Some  exampl es : 

SEDL  found  that  its  Task  3  activities,  which  were 
ess en t ial ly  the  dissemination  of  i  ts  programmatic  theme 
outcomes  to  state  decisionmakers,  were  tco  proactive  and 
not  in  a  position  to  respond  to  the  emerging  needs 
expressed  by  clients.  As  a  result  they  decided  to  begin 
a  wholly  new  program  (ED-AIDE)  in  1988-90  that 
represented  a  183  degree  change,  I.e.  to  a  program 
featuring  1 imlted  short-term/rapid-response  activities 
for  regional  partners  and  appropriate  resource 
development  activities. 

RBS  had  operated  Its  Task  3  program  on  a  state-by-state 
basis .  However ,  feedback  from  state  1 iaisons  Indicated 
Increasing  awareness  of  common  or  overlapping  concerns . 
Recommendations  have  been  made  to  disseminate 
Information  on  project  activities  1n  one  jurisdiction  to 
tht  other  four,  and  to  promote  project  activities  that 
encourage  and  Involve  multi-state  participation. 

Improve  Lab  Organization /Management .  Several  labs  had  external 
peer  review  teams  or  contractors  thai:  examined  Issues  of  lab 
governance  and  administration,  including  staff  development  and  the 
Improvement  of  self -assessment  Itself.  Exampl  es  of  recommendations 
and  changes  emerging  from  these  processes  are: 


NE/I  expanded  the  Executive  Committee  of  its  boa ^d 
from  10  to  12  and  from  two  chiefs  to  three  in  order 
to  address  concerns  about  ths  level  of  board  and 
especially  chief  Involvement. 

The  FWL  Evaluation  Advisory  Panel  recommended  thrt 
"You  should  stop  trying  to  produce  good  evaluation 
data,     beyond     the       required     minimums,     across  all 
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projects.  Rather,  you  should  work  intensely  with  two 
or  three  projects  that  seem  to  have  a  high  1 evel  of 
interest  or  capability  to  work  on  formative 
evaluation  or  documentation  case  studies.  Second , 
you  should  develop  a  minimal  set  of  institutional- 
level  accountabil i ty  indicators . "  (FWL  1 987  Self 
Assessment  Report ,   p.     48  .  ) 

Staff  development  is  listed  as  a  purpose  of  SA  only 
by  NCREL,  but  no  examples  are  provided.  Some 
recommendations  for  strengthening  staff  devel opment 
emerge  from  other  activities  in  other  laboratories 
(FWL  and  NE/I) . 

Comply  with  Contract  Requirements .  Contract  compliance  is  a 
purpose  more  appropriately  served  by  the  annual  reporcs,  but  it 
appears  to  be  a  central  feature  of  the  SA  reports  from  AEL ,  McREL , 
SEDL,  and  SEIL  .  Some  minimal  pragmatic  learnings  can  be  gleaned 
from  examples  of  "we  were  unable  to  do  X  because  of  barrier  Y."  But 
endless  spelling  out  of  program,  project,  and  activity  workscopes 
and  outcomes  can  be  'deadly.  OERI  might  consider  shifting  to  a 
management-by-exception  mode  to  avoid  this  difficulty  (as  well  as 
designating  the  annual  report  as  the  place  to  report  compliance 
information) . 

Increase  General  Knowledge.  The  RFP  gives  some  salience  to  the 
goal  of  building  the  knowledge  base  concerning  "effective 
strategies  for  improving  education  through  car ef ally  designed 
studies  of  how  its  own  dissemination  and  improvement  efforts  are 
working"  (p.  21).  Only  four  labs  state  this  as  a  purpose  of  their 
qA  efforts,  although  more  than  four  actually  report  on  "learnings" 
from  SA  activities.  Some  even  commissioned  special  evaluation 
studies  with  external   contractor o. 

An  interesting  gap  exists  between     the  empirical   findings  of  SA 
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activities  on  the  one  hand  and  statements  concerning  the  knowledge 
gained  on  the  other.  Most  of  the  reported  data-based  learnings  are 
pragmatic  end  ad  hoc  bits  of  craft  knowledge.  It  would  take  a 
major  effort  to  sift  through  them  to  find  patterns  and 
consistencies.  However,  several  labs,  notably  FWL  and  NE/I,  have 
provided  thoughtful  discussions  of  major  strategic  issues  that  are 
informed  by  experience  but  not  clearly  derived  from  SA  studies. 
Such  discussions  are  valuable  and  should  not  be  discouraged.  But 
there  is  a  desperate  need  for  some  theoretical  and  methodological 
frameworks  that  would  enable  the  design  of  SA  studies  that  might 
lead  to  more  general  principles.  Dunn's  work  on  the  ADD  model  and 
a  theory  of  applications  is  an  example  of  what  is  needed  (Dunn  1986 
and  1987). 
Model/Image . 

While  some  labs  approach  SA  and  its  related  evaluation 
quest i ons  in  a  somewhat  ad  ho~  manner ,  others  refer  to  a  more 
unifying  model  or  image .  Sorm  of  these  appear  more  in  the  design 
than  in  the  execution,  but  they  give  a  further  clue  as  to  SA 
aspirations.  Although  we  have  indicated  at  least  one  model  or 
image  for  every  lab,  some  had  to  be  inferred.  In  some  cases  an 
explicit  framework  is  laid  out  and  followed,  while  in  others  the 
image  may  be  part  of  a  background  discussion.  Although  in  most 
cases  there  is  only  one  such  model  or  image,  FWL  has  referred  to 
five. 

Systems/CI  PP.  It  is  fair  to  say  that  all  labs  use  systems 
concepts     at     least     implicitly,     and     that     systems     concepts  are 
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implicit  in  the  RFP.  They  all  employ  systems  diagrams  that  show  the 
flow  of  information  between  units,  with  feedback  loops,  etc.  AEL 
uses  an  explicit  input/output  model  that  shows  lab  output  as  an 
input  to  service  delivery  organizations.  NCREL  incorporates  the 
CIPP  model  (standing  for  context ,  input ,  process ,  and  product 
evaluation)     in       its     design.  (Note     that       context  evaluation 

corresponds  to  needs  assessment.) 

Management  Quality  Control .  Virtually  al 1  labs  view  SA  as  a 
tool  of  management  for  maintaining  control  of  operations  and 
assuring  accountability.  Tn  some  labs  this  perspective  is  the 
figure  and  in  others  the  ground.  Whether  there  is  an  explicit 
three-level  organizational  design,  project  information  is  reviewed 
by  program  heads,  and  program  information  is  reviewed  by  top 
management  and  the  board. 

Strategic  Planning.  We  have  said  that  the  overall  planning 
model  under  which  the  labs  operate  and  of  which  SA  is  a  component 
is  strategic  planning.  In  the  SA  context  it  comes  into  play 
primarily  in  addressing  the  relevance  evaluation  question. 

Goal -Free  Evaluation .  The  models  or  images  discussed  so  far 
all  represent  forms  of  goal-based  evaluation.  The  need  for 
account a bi 1 i ty  under  government  contracts  dictates  at  lease  some 
use  of  such  models.  Some  labs  (FWL  and  NCREL)  also  aspire  to  use 
goal -free  eval  uation  or  iti,  variants,  but  how  this  view  is 
implemented  is  unclear . 

Institutional  Renewal .  Finally,  "institutional  renewal"  is  the 
term  we  have  given     to  an  image    m  four   labs.       This  image  seems  to 
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be  related  to  the  fact  that  SA  is  part  of  the  planning  cycle  and 
through  successive  iterations  cf  that  cycle  the  institution  is 
con t  inuous  1  y  rer  rawing  i  tsel  f  . 

Mechanisms  for  Imp! ementation  of  Sel f -Assessment 

The  mechanisms  for  implementation  of  SA  are  the  ways  of 
collecting  SA  data  and  the  organizational  arrangements  for  review 
and  decisionmaking.  It  is  helpful  to  examine  these  mechanisms  at 
three  different  organizational  levels:  the  institutional,  program, 
and  project .  (Some  labs  incorporate  this  three-1 evel  schema  in 
their  SA  designs;  for  others  we  have  inferred  it.)  Lab  profiles  are 
shown  in  Table  5.  Some  labs  say  that  they  have  three-level  SA 
systems  but  have  limited  the  SA  report  to  institutional  level 
assessment .  However ,  some  program  and  project  level  information  is 
contained  in  these  reports. 

Institutional  Level >  SA  is  employed  by  top  management  and  the 
lab  board  to  review  the  overall  program  in  relation  to  the  lab 
mission.     Both  external   and  internal   mechanises  are  employed. 

Since  1980,  RBS  has  used  a  three-person  external  peer  review 
team.  the  Institutional  Review  Team,  to  provide  an  outside 
perspective  on  lab  functioning.  The  team  meets  twice  a  year  and 
focuses  on  different  aspects  of  the  lab  as  the  need  arises.  It  had 
a  constant  membership  for  several  years,  but  will  begin  rotating 
the  nrembership  in  1988.  One  of  the  outcomes  of  the  SEDL  SA  process 
was  the  decision  to  add  an  external  peer  review  team  to  its  SA 
system  in  1988-90.  To  emphasize  a  more  reflective  look  at 
institutional   improvement,    the  team     was  given  the  interesting  name 
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Table  5.  Mechanisms  for   Implementation  of  FY  1987-88  Self-Assessment  Designs 


Mechanism 


AEL       FWL     McREL  NCREL     NE/I  NWREL 


RBS 


SEDL  SEIL 


LEVEL 


A.  INSTITUTIONAL 

1.  EXTERNAL 

a.  Peer  review 

b .  Subcontractor 

1 .  Meta  eval  SA 

2 .  Gov/Mgmt 

3.  Program 

c.  Eval   advis  com 

d.  State  adv  comfs 

2.  INTERNAL 

a.  Mgmt  council 

b.  Mgmt  retreat 

c.  Portfolio  review 

d.  Eval  position 

e.  Bd  review 

f.  Task  5  theme 

g.  Compliance  rev 

B.  PROGRAM  LEVEL 

1 .  Advisory  Com 

2.  SA  report  focus 

3.  Match  needs  asses 

C.  PROJECT  LEVEL 
1.  DOCUMENTATION 

a.  Phone  logs 

b.  Request  logs 

c.  Field  contacts 

d.  Meeting  minutes 

e.  No.  copies 

f .  etc . 


X 
X 
X 
X 


X 
X 


X 
X 
X 
X 
X 


X 
X 


X 
X 


X  X 
X  X 


(NO  PROFILES  AVAILABLE) 


X 
X 

X 
X 


X 
X 


X 
X 

X 

X 


X 
X 
X 


** 


X 
X 

X 
X 

LL 


X 
X 
X 


X 
X 


2.  EVALUATION 

a.  Int  qual  asses 

b.  Ext  qual  asses 

c.  Feedback  mech 
d  .   Tracer  stud  ies 
e.   Special  studies 


X 
X 


X 
X 
X 


X 
X 


X 
X 


X 
X 
X 
X 


X 
X 
X 
X 


McREL  data  from   ^86  SA  report.     Final    1987  SA  report  not" 
McREL  preliminary  1987  report  used  OERI   site  review  panel 
SEDL  will  add  an  external   peer  review  panel   in  1983-90. 
***Dissol ved   in  198d 


yet  available, 
report  as  focuj. 


CHAPT   III   PLANNING  Page   I  I  1-40 

IR*  Team,  standing  for  institutional  review,  reflection,  and 
renewal .  A  different  kind  of  external  peer  review  is  provided  by 
the  OERI  site  review  teams.  A  number  of  labs  report  the  comments 
of  these  teams  and  cheir  responses  to  them.  A  preliminary  draft  of 
the  McREL  1987  SA  report  took  the  form  of  responses  to  the  comments 
of  i  ts  OERI  site  review  team,  but  this  report  is  not  the  one  cited 
in  our  tabulations. 

In  other  cases,  subcontracts  are  let  to  external  organizations 
to  perform  specific  evaluations.  Both  AEL  and  SEIL  use  this  device 
and  employ  this  method  for  obtaining  a  meta  evaluation  of  the  lab's 
own  SA  efforts  as  well  as  evaluations  of  lab  management  and 
programs.  The  SEIL  subcontract  also  examines  lab  governance.  In 
both  cates,  subcontractors  conducted  tracer  studies  of  specific  lab 
programs. 

Another  external  device  is  use  of  an  external  advisory 
committee  specifically  to  advise  the  lab  on  its  sel f -assessment 
design  and  operation.  FWL  employs  such  a  group.  In  operation  this 
group  seems  to  go  beyond  this  charter  at  times  to  function  more 
like  a  peer  review  team  for  the  total  lab  operation.  NWREL  employs 
a  "consultant  review  panel"  but  provides  little  information  on  its 
operat i  on . 

State  advisory  committees ,  which  provide  needs  assessment 
input,  often  function  as  an  SA  mechanism  as  well.  Some  labs  use 
thes  committees  to  review  lab  documents  and  products  as  part  of  the 
quality  assurance  system. 

Other  mechanisms     are  internal   to     the  lab.     Four     labs  mention 
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some  form     of  top     management  counci 1     consisting  of     the  executive 

director     and  program     heads   that     advised  the     executive  director. 

The    mechanisms  used     by  boards     vary  and     are  not     a 1  ways  easy  to 

identify.       Where  the     lab  is     part  of     a  much     larger  organization 

there     is     usually     a       subcommittee     with     special      lab  oversight 

responsibilities.       FWL  has     devised  a     specific   technique  modeled 

after  financial    investment  models  called  port f ol i o  review: 

To  accomplish  the  review  of  the  entire  portfolio,  a 
four-part  form  is  used.  In  part  one,  the  portf ol io  is 
scanned  and. . .seven  questions  are  answered  pertaining 
to:  risks;  probability  of  payoff  in  terms  of  affecting 
school  c  •  classroom  improvement;  benef i t-to-cos t  ratios; 
helping  the  Laboratory  to  develop  or  improve  its 
capabilities  to  work  with  and  through  other  agencies; 
improvements  in  the  capacity  to  serve  as  a  regional 
laboratory;  successful  cost-sharing ;  and  maintaining  a 
good  reputat  i  on  wi  t h  key  constituencies. 

...the  primary  purpose  of  these  questions  is  to  promote 
discussion  among  staff  that  engender  better  common 
understanding  of  the  strengths  and  weaknesses  of  the 
total   program . . . 

Part  two  of  the  review  is  a  scan  of  devel opmental  areas . 
This  scan  responds  to  six  questions:  identify  potential 
activities  that  would  help  FWL  respond  more  effectively 
to  emerging  nesds;  which  client  groups  are  served  least 
well;  assistance  strategies  that  are  most  strongly 
represented  in  the  current  program;  promising  technical 
assistance  strategies  that  are  most  lacking;  the  most 
productive  or  promising  things  the  Laboratory  is  doing 
in  developing  an  effective  and  efficient  R&D  support 
capability;  and  the  most  critical  or  important 
capabi 1 i  t i  es  that  are  needed  to  be  more  effective  in 
meeting  regional  and  national  expectations  for  a 
reg  ional   1  a bora tor y . 

Part  three  is  an  evaluation  of  the  total  portf ol io . 
Again,  a  seven-point  agreement  rating  scale  is 
employed ...  ranging  from  low  to  high  agreement.  The 
instructions  are,  "Considering  the  present  set  of 
act  ivi  t i  es  contained  in  the  Regional  Programs  portfolio, 
how  would  you  rate  the  portfolio  on  the  following 
characteristics?"    [fifteen  characteristics] 


9 

^  J 


CHAPT   III  PLANNING 


Page   III  —4 if 


Part  four  of  the  portfol  io  review  is  a  contingency 
pi anninq  exercise ,  which  calls  for  responses  to... three 
questions  [hypothetical  ten  percent  increase  in  funding , 
ten  percent  cut,  and]  what  do  you  see  as  being  the  most 
promising  things  we  could  do  to  increase  the  return  on 
investment  of  our  present  set  of  resources? 
(FWL  Second  Annual  SaVf,  Evaluation  Report,  pp.  11-13, 
italics   in  original). 

This  illustrates  how  a  technology  can  be  developed  to  implement 
aspects  of  SA . 

Seven  labs  have  designated  a  specific  internal  evaluator 
position  in  the  office  of  the  executive  director  as  the  locus  of 
responsibility  for  lab  SA.  In  others,  this  is  a  responsibility  of 
some  other  official.  Specific  sub-tasks  may  be  delegated  to  line 
uni  ts . 

There  Is  a  Task  5  theme  for     SA ,   for  which  SEDL  is  the  lead  lab 

and  in  which     all   labs  participate.     Meetings     of  staff  responsible 

for  SA     have  been  held  and     labs   have  shared  their     SA  reports  with 

each  other.     A  report  on  FY  1987  activities   lists  four  objectives 

of  this  of  the  collaboration   (Hoover  1988); 

o  To  strengthen  each  individual  institution's 
evaluation  efforts  by  sharing  expertise  and  ideas 
concerning  laboratory  evaluat i  on  purposes ,  designs , 
implementations ,   and  resul ts 

o  To  assist  the  planning  and  implementation  efforts  of 
OERI  as  it  carries  out  its  responsibilities  in 
Laboratory  evaluation  by  providing  input  on  effective 
and  efficient  ways  to  collect  and  use  laboratory 
eva 1 uat  i  on  i  nf or mat  ion 

o  To  provide  a  broadened  perspective  on  laboratory 
operations  by  synthesizing  evaluation  information  un 
the  effectiveness  of  selected  major  laboratory 
strategies 

o  To  enhance  planning  for  subsequent  laboratory  efforts 
by  monitoring  current  trends  in  laboratory  evaluation 
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work       and     reporting       on     accomplishments       of  the 
col  1 aborat  i ve 

Program  Level .  For  the  most  part  the  designs  say  relatively 
little  about  special  mechanisms  at  the  program  level.  Basically  SA 
at  that  level  appears  to  consist  of  review  by  the  program  head  and 
his  or  her  project  directors  of  project  level  data.  A  number  of 
tne  SA  reports  are  organized  by  program.  This  is  probably  the 
primary  level  for  the  conduct  of  compl i  ance  reviews .  Program 
advisory  committees  are  a  specific  mechanism  used  by  three  labs. 
But  it  is  hard  to  find  mechanisms  for  determining  whether  the 
programs  are  more  than  the  sum  of  their  project  parts. 

Project/Activity  Level .  Most  SA  data  are  collected  at  the 
project/activity  level.  Labs  attempt  documentation  of  many  aspects 
of  their  operation.  M  For  example,  they  maintain  logs  of  phone 
calls,  document  requests,  field  contacts,  etc.  As  mentioned 
earlier,  AEL  listed  28  forms  of  documentation;  but  not  all  labs 
provide  such  lists,  and  no  attempt  'nil  be  made  here  to  profile  all 
documentation  activities . 

We  will  attempt  a  more  specific  profiling  of  evaluation 
mechanisms.  Most  labs  have  some  form  of  internal  qua 1 i  ty  assurance 
that  reviews  reports  and  products  for  editorial  and  technical 
quality.  Five  have  external  qua! i ty  assurance  systems  as  well. 
For  the  most  part  this  consists  of  using  rating  forms,  which  are 
also  used  as  feedback  mechan  isms  to  determine  the  reactions  of 
part ici  pap ts  in  workshops  and  in  other  meetings .  Such  mechanisms 
may  provide  important  formative  data     to  lab  writers  and  developers 
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but  are  rarely  of  general  interest. 

Special  mention  needs  to  be  made  of  tracer  stud i es  and  other 
special  studies  that  use  more  sophisticated  designs  to  evaluate 
specific  projects.  Both  AEL  and  SEIL  employed  outside  subcon- 
tractors to  conduct  tracer  studies  to  determine  whether  impacts 
could  be  traced  from  primary  clients  to  secondary  clients  (both 
with  disappointing  results).  SEDL  attempted  to  build  tracer  data 
into  its  documentation  system,   but  had  little  success. 


Comments  on  Planning 

Conceptual  Issues 

This  chapter  has  covered  a  lot  of  territory-  The  implicit 
strategic  planning  model  has  included  needs  assessment,  regional 
capacity,  and  self-assessment.  The  position  taken  here  is  that 
planning  is  the  best  term  for  this  complex  set  of  operations 
focused  on  the  use  of  information  for  decisionmaking.  One  problem 
encountered  is  that  each  of  the  components  of  planning  has  tended 
to  "imperialistic,"  i.e.,  each  component  concept  tends  to  expand 
to  include  territory  claimed  by  the  others.  For  example,  needs 
assessment ,  as  conceptual  ized  by  Kaufman ,  has:  been  expanded  to 
include  the  entire  territory  we  have  termed  "planning."  Similarly, 
evaluation  has  been  used  for  the  same  purpose  in  the  CIPP  model  . 
In  the  present  analysis  sal f -assessment  starts  as  a  discrete 
component  of  the  strategic  planning  process,  but  when  one  examines 
the  sel f -assessment  reports  they  seem  to  include  far  more  than 
sel f -assessment   " properly  so-cal 1 ed . " 
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Under  these  ci  rcumstances ,  it  is  not  surprising  to  see  certain 
kinds  of  information  appearing  in  multiple  reports  (i.e.,  plans, 
needs  assessments,  self-assessments,  and  annual  reports) .  The  labs 
and  OERI  need  to  work  together  to  sort  out  the  several  purposes  and 
reports  so  that  each  kind  of  information  has  its  proper  place.  The 
peed  is  to  narrow  the  scope  of  each  component  concept  to  avoid 
overlap  and  exclude  extraneous  matters.  In  the  sections  below  I 
will  comment  on  each  of  the  concepts  and  suggest  some  steps  that 
might  be  taken  to  achieve  this. 
Needs  Assessment 

On  the  whole,  labs  seem  to  do  a  reasonably  good  job  of 
assessing  the  needs  of  their  regions.  A  variety  of  methods  have 
been  tried  and  many  produce  useful  information.  No  doubt  lab  staff 
members  have  an  even -better  "feel"  for  their  regions  than  emerges 
from  their  formal  methods. 

Nevert hel ess ,   there     are  improvements  that  might     be  made .  One 

need  is     some  con jeptual   clarification     as  to  the     various  possible 

types     of  need     (see  above).       Another  is     to  recognize     that  needs 

exist     at     different     "levels     of       generality.       It     is     useful  to 

distinguish  three  le^ls  of  general  ity ,  i.e.: 

o  Level   of  educational   functions;   e.g.     improve  teaching 

o  Level     of     choice:       e.g.,      improve     beginning  teacher 
induct  ion 

o  Level   of  design  decisions:  e.g.,     best  ways  to  design  a 
mentor  teacher  program . 

The  level   of  educational   functions  -*s   largely  inappropriate  for 
needs  assessment.       Every  lab  should     heve  the  capacity     to  provide 
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services  for  each  of  the  major  functional  areas  of  education.  (I 
say  "largely"  because  there  is  the  secondary  consideration  of  the 
balance  of  effort  among  these  areas.)  At  the  other  extreme,  the 
level  of  design  decisions,  choices  should  be  based  on  the  best 
available  research  and  craft  knowledge;  i.e.,  the  decisions  are 
technical  decisions.  Needs  assessment  should  be  focused  on  the 
middle  level  of  generality,  i<e.  the  level  at  which  values  and 
interpretations  of  the  regional  context  operate. 
Regional  Capability  Assessment 

As  indicated  above,  this  was  the  most  poorly  implemented 
component  of  the  planning  model.  No  doubt  the  labs  have  better 
information  on  this  topic  than  appears  in  their  reports,  if  only 
the  personal  knowledge  of  the  staff.  However,  we  cannot  understand 
whether  this  componen-t  is  contributing  to  the  planning  function 
unless  this  knowledge  and  its  application  are  made  explicit.  While 
an  important  start  on  the  methodology  of  this  assessment  was  made 
by  the  ARROE  Study  (Frankel  et  al  1979),  elaborations  are  needed  to 
make  the  measurement  of  organizational  capacity  commensurate  with 
other  el ements  of  the  pi ann  ing  model ,  i.e.,  needs  or  pol icy 
doma  ins,  improvement  capac  i  1 1 es ,  and  linkage  ca  paci  t  i  es . 
Self -Assessment 

The  sorting  out  of  multiple  purposes  needs  to  take  place 
primarily  in  the  sel f -assessment  component .  A  number  of  the  1 abs 
used  a  three-level  model  that  identified  SA  questions  and 
mechanisms  at  institutional     program,   and  project  levels. 

Not     all   these     levels  are     appropriate.     The     1986  SA  reports 
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included  a  much  formative  evaluation  data  from  the  project  level. 
The  older  labs  have  a  strong  background  in  development,  and  they 
col lect  a  significant  amount  of  data  aimed  at  making  design 
decisions  for  fine-tuning  product  development-  However,  even  here 
there  are  problems.  For  the  most  part  these  studies  have  yielded  a 
large  amount  of  craft  knowledge  that  has  yet  to  be  codified  and  has 
only  limited  potential  for  building  a  knowledge  base  of  more 
general  application.  Most  evaluation  is  "black  box"  evaluation; 
e.g.  clients  are  asked  to  evaluate  some  product  whose 
characteristics  have  not  be  specified  and  for  which  the  strategy 
for  bridging  organizational  space  has  not  been  described.  Where 
are  the  studies  that  compare  the  effectiveness  of  two  workshop 
formats  for  the  same  type  of  audience  or  of  one  format  with  two 
types  of  clients?  Where  are  the  studies  that  compare  two  ways  of 
organ iz ing  net wor ks? 

It  was  recognized  that  most  of  the  formative  evaluation  data 
supplied  in  the  1986  SA  reports  was  not  very  useful  for  SA 
purposes,  and  most  lajps  complied  with  a  request  to  reduce  the 
amount  of  this  detail  in  the-ir  1987  reports.  The  next  step  would 
be  to  recognize  that  formative  evaluation  data  are  part  of  the 
development  process  and  should  be  excluded  from  sel f -assessment  . 
The  relevant  SA  question  would  be:  "Do  we  have  adequate  methods  of 
formative  evaluation  in  place  in  each  program?" 

Similarly,  a  great  deal  of  the  documentation  data  (phone  logs 
etc.)  may  provide  a  useful  descriptive  context,  but  they  are  either 
grist  for  the  formative  evaluation  mill   or  mere  counts  that  require 
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interpretation  if  they  are  to  be  understood  in  a  sel f -assessment 
context . 

Also,  deta  i 1 ed  contract  com pi iance  data  are  not  the  stuff  of 
thoughtful  consideration  of  lab  mission  and  strategy.  They  belong 
in  quarterly  and  annual  reports,  not  self -assessment  raports,  and 
there  only  on  a  management-by-exception  basis. 

It  is  recommended  that  sel f -assessment  (reportable  to  OERI)  be 
limited  to  the  institutional  and  program  levels  and  focused  more 
sharply  on  two  aspects  of  lab  operation:  issues  of  organization  and 
governance  (&.g.,  is  the  lab  organized  in  accordance  with  and 
operating  within  its  mission?),  and  issues  of  strategy,  (i.e.,  is 
the  lab  responding  to  the  needs  of  the  region,  is  it  using  the  best 
improvement  and  linkage  strategies,  and  is  it  contributing  to  the 
knowledge  base  concerning  these  strategies?).  It  appears  that, 
with  few  exceptions,  lab  SA  is  not  focused  on  the  strategic 
questions  of  lab  operation.  (The  notable  exceptions  are  the  AEL 
study  of  the  study  group  methodology  and  the  AEL  and  SEIL  tracer 
studies . ) 

Another  problem  is  the  unavoidable  overlap  between  SA  and 
OERI's  desire  to  evaluate  the  laboratory  program  as  a  whole.  Given 
the  history  of  prickly  relationships  between  the  labs  and  the 
government  and  the  labs'  strong  sense  of  vulnerability,  is  a 
surprising  amount  of  candor  appears  in  their  reports.  While  it  is 
understandable  to  want  to  put  a  good  face  on  everything,  the  labs 
acknowledge  numerous  problems  and  weaknesses . 

More  candor  might  be  forthcoming   if  more  of  a  separation 
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between  sel f -assessment  and  OERI  evaluation  could  be  achieved.  One 
suggestion  would  be  to  try  a  different  set  of  labels.  "Evaluation" 
and  " assessment"  are  terms  that  automatical ly  trigger  defensive 
mechanisms  and  stifle  the  intended  learning  and  renewal  purposes. 
Problems  might  be  avoided  by  legitimizing  a  laboratory  research 
program  to  study  laboratory  operations  and  functions,  thus  helping 
to  move  the  labs  away  from  their  excessively  empirical  approach 
toward  a  more  t heoret  ically  rel evant  agenda  .  The  res ear c  h  fields 
involved  include  interorganizat ional  theory,  knowledge  utilization, 
dissemination,  and  social  change.  Labs  should  be  contributors  as 
well   as  consumers  of  research  in  these  fields. 

A  1 imi ted     amount  of     work  of     this  kind     has  been     done ,  e.g., 
AEL's  examination     of  the  effectiveness     of  study  groups  as     an  R&D 
methodology  and  the  SEIL  tracer  studies. 
Reprise  on  Rational  Planning 

While  planning  is  inevitably  a  proactive  approach  to  problems , 
labs  are  also  expected  to  be  reactive.  More  than  that,  as 
sociologically  marginal  institutions  they  are  constantly  in  the 
position  of  having  to  renegotiate  their  role  in  the  regional 
infrastructure.  The  reports  contain  many  examples  of  how,  for 
example ,  a  whol e  new  rel at ionshi  p  to  an  SEA  had  to  be  worked  out 
when  there  was  a  change  in  chiefs.  Such  events  create  havoc  with 
carofuly  laid  plans.  The  entire  planning  process  needs  to  be 
examined  to  determine  which  parts  have  heuristic  value  and  which 
ones  play  only  ritualistic  roles. 
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CHAPTER  IV 

WORK  WITH  STATE  LEVEL  DECISIONMAKERS 
ON  SCHOOL   IMPROVEMENT  ISSUES 

Introduction 

Ever  since  the  beginning  of  the  educational  reform  movement 
triggered  by  the  report  of  the  National  Commission  on  Excellence,  A 
Nation  A£  Eiskr  education  policy  issues  have  been  much  more  salient 
at  the  state  level.  Many  governors  and  state  legislatures  have 
placed  educational  improvement  high  on  their  agendas,  and  the 
National  Governors T  Association  has  issued  its  own  report  (National 
Governors*  Association,  1986).  Probably  the  key  to  the  new  focus 
on  educational  issues  has  been  the  realization  of  the  Importance  of 
a  strong  educational  system  in  the  inter-state  competition  for 
economic       development.         A       number     of       states       have  adopted 

comprehensive  school   improvement  programs     and  virtually  a.  states 

V 

have  undertaken  specific  reform  initiatives  that  go  beyr  d  the 
usual  financing  issues.  State  level  professional  associations,  and 
groups  representing  business,  labor,  and  parents  have  been  active 
in  the  accompanying  policy  debates. 

However,  the  states  vary  greatly  in  their  capacity  to  deal  with 
these  issues.  Larger  states  such  as  New  York  and  California  have 
sophisticated  staff  in  their  SEAs  and  policy  aides  in  the 
governor's  office  and  legislative  committees,  but  many  others  are 
ill-equipped  to  deal  with  the  problems  of  policy  formulation, 
implementation,  and  assessment.  Further,  states  also  vary  greatly 
in     the     availability     of       non-governmental     resources     from  such 
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entities  as  universities  and  research  ^jirms. 

It  is  in  this  context  that  we  examine  Task  3,  which  requires 
that  labs  "work  with  s t a t e— 1 ©ve 1  decisionmakers  on  school 
improvement  issues."  Three  illustrative  tactics  are  listed  in  the 
RFP:  technical  assistance,  providing  issue-specific  analyses  and 
syntheses ,  and  facilitating  commun  i cat ion  among  state- 1 evel 
dec  is i  on makers . 
Federal  Specifications 

Unlike  Tasks  2  and  4,  which  involve  the  "with  and  through" 
strategy,  Task  3  states  that  the  lab  will  work  with  state-level 
decisionmakers.  This  may  or  may  not  be  a  dist  irct^'on  without  a 
difference.  State-level  groups  are  intermediaries  with  regard  to 
school  improvement  at  the  local  level.  However,  if  the  focus  is  on 
reform  at  the  state  policy  level,  state-level  decisionmakers  can  be 
considered  direct  clients  and  the  labs  will  be  Judged  on  the  basis 
of  their  delivery  of  direct  services  for  Task  3. 

6ut  what  does   it  mean  to  "work  with"   state-level  decisionmakers 


on  school  improvement  issues?  It  is  important  to  note  that  policy 
making  is  a  social  process  while  policy  analysis  is  an  intellectual 
activity  (Dunn,  1986).  Some  observers  have  questioned  the  value  of 
professional  social  4 nqui  ry  in  af f ect  ing  the  pol icy  process 
(Lindblom  and  Cohen,  1979).  Perhaps  this  is  due  to  the  primitive 
state  of  policy  analysis  and  the  lack  of  a  sound  theory  of 
applications  (Dunn,  1986).  In  any  case,  the  mission  of  the  labs 
under  Task  3  is  to  assist  state-level  policy-makers  to  make  better 
use  of  knowledge  at  various  stages  of  the  pol icymaking  process . 
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State  Education  Pol  icy  Consortium 

In  1983  NIE  funded  a  two-year  project  with  the  State  Policy 
Consortium,  a  group  made  up  of  the  Council  of  Chief  State  School 
Officers,  the  Education  Commission  of  the  States,  the  National 
Association  of  State  Boards  of  Education,  the  National  Conference 
of  State  Legislatures,  and  the  National  Governors'  Association. 
These  national  organizations  count  as  their  members  many  of  the 
principal  state-level  decisionmakers  who  are  the  targets  of  the  lab 
Task  3  efforts.  Among  other  things,  the  project  was  designed  to 
"...[improve]  our  understanding  of  the  sources  of  information 
policymakers  rely  on,  and  of  effective  strategies  for  disseminating 
research  to  policymakers"  (Cohen,  1985a,  p.  ii.  See  also  Cohen, 
1985b;  Fuhrman  and  McDonnell,  1985a  &  1985b).  In  addition  the 
study  made  recommendations  on  the  roles  of  the  Consortium 
associations,  the  regional  labs,  the  Center  for  Policy  Research  in 
Education,   and  OERI. 

The  project  was  completed  in  1985  at  the  time  that  the  new  labs 
were  being  organized,  and  a  meeting  was  held  involving  Consortium, 
lab,  and  OERI  staff.  As  a  result,  the  laos  had  the  results  of  this 
project  available  at  the  time  their  new  contracts  began  (although 
not  necessarily  at   the  time  the  plans  were  written). 

A  major  f  indi  ng  of  the  research  was  the  strong  interest 
expressed  among' all  states  and  stakeholders  in  having  available 
information  on  the  specific  policy  issues  being  addressed  by  other 
states  .  The  project  had  collected  a  list  of  state  policy  "data 
bases,"       many     of       which       were     collected       by     the  Consortium 
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organizations,  but  many  of  these  consisted  of  one-time  studies. 
The  report  made  recommendations  concerning  coordination  and 
improvement  in  the  collection  of  useful  data  by  the  member 
organizations .  Three  roles  for  the  labs  were  suggested  (Cohen, 
1985b) : 


o  Cooperation  in  developing  in-depth  descr i pt ions  of 
state  policy  provisions,  on  a  50-state  basis,  in 
selected  policy  issue  areas  (initially  rejected  by  labs 
at  meeting  with  Consortium  staff   in  1985) 

o  Conduct  of  studies  of  the  Implementation  and  impact  of 
state  pol icy  Initiatives 

o  Creation  of  an  Information  bcise  of  studies  of  state 
policy  Implementation  and  impact  conducted  by  other 
agencies  and  serving  policy  formulation  needs 


Elsewhere  labs  were  urged  to  adopt  dissemination  strategies 
that  "allow  for  easy  access  to  Information,  low  consumption  costs 
for  the  user,  a  direct  application  of  Information  to  specific  state 
or  policy  contexts,  and  timely  receipt  of  information.  Especially 
valuable  is  the  use  of  structured  meetings  that  encourage  an 
inf  ormal  interaction  between  Information  users  and  Information 
providers"  (Cohen,  1985b,  p.  67).  Further,  1n  recognition  of  the 
importance  of  Instate  sources  of  information,  the  1 abs  shoul d 
establish  or  strengthen  Instate  issue  networks.  This  would  involve 
Identifying  sources  of  expertise  and  bringing  them  together  w*th 
state  pol 1cy makers .  Strengthen  ing  the  capaci  ty  of  the  State 
Education  Policy  Seminars  (SEPS),  jointly  sponsored  by  ECS  and  I  EL , 
was  recommended.  Finally,  labs  can  play  a  strong  role  1n 
connecting  state  policymakers  with  national  and  state  R&D  networks 
and     1n     studying  local     district     and     school   responses     to  scate 
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improvement  Initiatives. 
Met  hodol og  ica 1  Issues 

This     is  the     first  place     that  we     encounter  a  methodological 

Issue  common  to  Tasks  2-5,  namely  the  choice  of  a  unit  of  analysis. 
The  most  detailed  analysis  could  be  done  if  we  could  Identify  and 
classify  each  project  or  act iv1 ty  conducted  over  the  two-year 
period.  However,  this  is  difficult,  if  nor  Impossible,  for  several 
reasons.  First,  while  some  activities  are  discrete  units  of  work 
having  finite  time  lines  and  determinable  characteristics,  others 
are  ongoing  services  of  a  more  open-ended  nature  (e.g.,  data  base 
maintenance).  Second,  the  amount  of  Information  available  and  the 
conceptual  frameworks  used  vary  greatly  from  project  to  project  and 
from  lab  to  lab.  Third,  there  is  no  uniform  way  of  structuring 
work  into  programs,  projects,  activities,  and  t$ub-act1vi  t  ies .  As  a 
result,  cruder  methods  are  used  here  that  apply  to  the  entire  task 
area  for  each  lab.  Indicating  either  presence  or  absence  of  a 
particular  tactic,  or  sometimes  a  degree  of  emphasis  (high,  medium, 
low).  Based  on  these  data,  the  attempt  will  be  to  find  patterns 
1nd1cat  1  ve  of  broader  s trateginss . 
Organization  of  Chapter 

The  following  sections  describe  lab  activities  under  Task  3  for 
the  three  strategic  dimensions  of  linkage  strategy,  improvement 
strategy,  and  educational  need;  Identify  the  policy  stage  most 
frequently  addressed;  examine  the  national  coordination  of  state 
policy  activities;  and  then  present  a  holistic  picture  of  each 
lab's  Task  3  program .     Comments     summarizing  the  analysis  appear  at 
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Findings 


This  t«sk  has  the  three  strategic  dimensions  of  the  cube 
presented  1n  Chapter   I . 

First,  each  lab  needs  to  design  a  linkage  strategy  by  deciding 
who  its  primary  clients  are  and  how  1t  will  relate  to  them.  (Note 
that  such  "designs"  allow  for  the  possibility  of  opportunistic 
strategies.)  A     lab  1s  expected     nor  only  to     mediate  relationships 


among     organizations  within     the  region     but  to     provide  access  to 


national    resources  with  more  context-specific  assistance. 

Second,  each  lab  needs  to  design  an  improvement  strategy  1n 
terms  of  some  mix  of  KPU--  functions  as  they  apply  to  selected  stages 
of  the  policy  process. 

Th1 rd ,  each  lab  needs  to  determine  whether  it  will  attempt  to 
work  across  a  more  or  less  comprehensive  set  of  policy  issues  or 
domains  or  focus  on  a  limited  number  of  such  Issues,  and,  1f  the 
latter,   which  ones. 

Cross-cutting  these  dimensions  1s  a  distinction  concerning  the 
goal  of  the  activity:  is  the  activity  intended  to  bui 1 d  capacity 
for  policy  analysis  (either  the  lab's  cr  thct  of  some  other  entity) 
or  to  £t°  pol 1cy  analysis? 

Although  the  focus  of  this  chapter   is  on  Task  3,   one  of  the 
themes  devel oped  under     Task  5  (cross  lab     coordination)  deal s  with 
state  policy  also  and  1s  addressed  here. 


national 


resources . 


Lab 


regl onal     services     should  complement 
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State  Pol  icy  Linkage  Strategy 

Profiles  of  the  linkage  strategies  employed  by  labs  in  their 
second  contract  year  are  shown  in  Table  6.  This  table  should  not 
be  taken  as  definitive  because  a  service  not  shown  in  the  table 
might  be  found  under  another  task.  In  addition,  data  are  derived 
both  from  plans  and  from  progress  reports,  and  sometimes 
discrepancies  appear.  Nevertheless,  the  table  is  indicative  of 
broad  patterns . 


Table  6.   Profiles  of  Lab  Task  3  Linkage     Strategies     for  Working 
with  State-Level   Decisionmakers  on  School    Improvement  Issues. 

Linkage  Laboratory  

Strategy  AEL       FWL     McREL  NCREL     NE/I  NWREL     RBS     SEDL  SEIL 

Component 


1 . 

Col  1 aborators 

a . 

Regional 

HE 

SPA 

SEPS 

SEAs 

SEA , HE 

ISA 

H 

b. 

National 

CVE 

CPRE 

ECS 

ECS 

CPRE 

CPR 

2. 

CI ients 

a . 

Primary 

CH 

CS 

S 

CS 

CS 

CS 

S 

SG 

CH 

b. 

Range 

N 

6 

M 

B 

M 

8 

N 

M 

M 

c . 

Type 

N 

0 

AH 

0 

0 

0 

N 

3. 

Communication 

a . 

Approach 

S,R 

R 

S,R 

S 

• 

S 

R 

S 

S 

R 

b. 

Type 

M,R,B 

R 

C,M 

M ,  R 

M ,  R  R, 

M,P 

P 

8 

R 

LEGEND: 

1.a.   Regional   Coll aboratorrs ;   Higher  Ed   Instituions;  State 
Prof  Assoc;  Xntermec' i at e  Service  Agency 

1.  b.   National   Collaborators:   CPRE,   CVE   (Center  for  Voc  Ed);  ECS 

(Ed.  Commission  of  the  States) 

2.  a.   Primary  Clients:   Chiefs,   SEAs ,   State  Gov't,   Cross  Section 
2.b.   Range  of  Clients:   Narrow,   Medium,  Broad 

2.  c.   Type  of  Clients:   Ad  Hoc,   Network,  Organization 

3.  a.   Communication  Approach:   State,  Region 

3.b.  Communication  Type:   Meetings,   Reports,  Briefings, 

Consultations ,  Products 
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The  three  major     dimensions  of  the   linkage     strategy  are  "three 
Cfs" :  collaborators,   clients,   and  communication  modes. 

Col laborators .  Collaborators  are  not  nearly  as  significant  for 
Task  3  as  for  Tasks  2  and  4  because  the  "with  and  through"  strategy 
is  not  Involved.  At  the  national  level,  the  Center  for  Policy 
Research  in  Education  at  Rutgers  University  cosponsored  regional 
policy  symposia  with  NCREL ,  SEDL ,  and  SEIL,  and  the  Center  for 
Vocational  Education  collaborated  with  AEL .  ECS  worked  on  projects 
with  NE/I  ana  NWREL .  Regional  collaborators  include  SEAs, 
Intermediate  Service  Agencies,  Inscitutions  of  Higher  Education, 
and  SEPS  units  (which,  o+  course,  are  instrumentalities  of  two 
national   organizations,    ECS  and   I  EL) . 

CI 1ents .     The  number  of   possible  groups  to  serve  is  considerabl 
A  list  of  the  major  potential   clients  would  include: 

o  Chief  state  school  officers 

o  Other  SEA  personnel 

o  State  board  of  education 

o  State  higher  education  CEO  and  board 

o  Governor 

o  Governor's  aides 

o  Legislators 

o  Leg i a  1  at i ve  aides 

o  State  prof ess  ion a  1  associations 

o  State  business  associations 

o  State  labor  associations 

o  Other  state  advocacy  groups 

o  Intermediate  agencies 

o  LEAs 

The  latter  two  categories  are  included  because  they  are  sometimes 
involved  in  lab-sponsored  meetings  even  though  Task  3  is  directed 
at  state- 1 evel  decisionmakers. 

While  there     may  be     a  desire     to  work     with  all     these  groups, 
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limited  resources,  the  number  of  states  or  other  units  to  be 
served,  and  other  considerations  require  some  choices.  The  Issues 
that  arise  regarding  client  selection  are: 


Although,  In  a  sense,  SEA's  are  the  primary  cl 1ents  of  all 
labs,  the  variations  on  this  theme  are  conslcerabl e .  For  AEL  1t  Is 
hard  to  overestimate  the  centrallty  of  the  chiefs  as  significant 
others.  They  all  serve  on  the  Board  of  Directors  and  collectively 
constitute  the  Council  on  Policy  and  Planning,  which  serves  three 
functions:  (1)  1t  has  special  responsibility  for  reviewing  lab 
projects  regularly  and  recommending  to  the  Board  any  changes  In 
overall  lab  direction?  (2)  1t  serves  as  thr  Advisory  Board  for  the 
Policy  and  Planning  Center  (i.e.,  the  Task  3  program);  and  (3) 
Individually,  the  Council  members  are  the  primary  clients  of  the 
Policy  and  Planning  Center. 

For  most  labs  the  SEA  as  a  whole  1s  the  primary  client.  RBS 
goes  further  than  any  other  lab  1n  defining  Itself  as  an  adjunct  to 
SEAs.  (For  details  see  the  RBS  configuration  below.)  Most  labs 
also  try  to  relate  to  other  elements  of  the  state  government,  i.e., 
the  governor's  office  and  legislative  committees.  SEDL  seems  to 
have  the  most  balance  1n  Its  attention  to  the  several  components  of 
the  state  government. 

Four  labs  deal  with  a  cross  section  of  state-level 
decisionmakers  that  goes  beyond  state  government  to  Include  state 
professional   associations  and  various     advocacy  groups   ( FWL ,  NCREL, 


o  Which  groups  are  given  primacy? 

o  Is  the  range  of  clients  broad  or  narrow? 

o  What  form  does  the  client  group  take? 
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NE/I,  and  NWREL) .  (Not  that  oiher  labs  exclude  such  groups;  it  is 
a  matter  of  emphasis  and  balance. ) 

This  discussion   leads     into  a  characterization  o4      the  range  of 


Table  3  is  admittedly  impressionistic  but  takes  us  a  step  beyond 
identifying  the  primary  client.  AEL  and  RBS  seem  to  have  the 
narrowest  focus  on  state-level  decisionmakers,  and  FWL,  NCREL,  and 
NWREL  the  broadest. 

Finally,  the  type  of  client  may  be  a  formal  organization, 
networks  of  individuals,  or  ad  hoc  collections  of  individuals. 
Coding  of  this  Item  is  particularly  difficult  because  the 
individuals  served  Invariably  have  roles  in  client  organizations. 
But  it  makes  a  big  difference  whether  the  Individual  is  involved 
for  persorsl  reasons-  (e.g,  professional  development)  or 
organizational  reasons  (e.g.,  Implementation  of  a  training 
program).  As  we  shall  see  below,  at  least  one  lab  made  the  mistake 
of  selecting  for  a  trainer  of  trainers  program  Individuals  who  had 
no  organizational   responsibility  for  inservlce  training. 

For  Task  3  most  labs  seem  to  emphasize  the  formal  organization 
as  the  client.  For  example,  NWREL  has  a  broad  clientele  and  often 
makes  presentations  at  meetings  of  professional  associations  and 
other  groups.  In  a  number  of  cases  networks  have  been  established 
among  legislative  aides  in  different  states  or  among  legislative 
aide*,  governors  aides,  and  SEA  policy  representatives.  We  also 
classified  tha  chiefs  involved  with  the  AEL  Policy  and  Planning 
Center     as  a     network,  although     it     might  be     considered  a  formal 


clients  as  narrow,  medium,   or  broad . 


The  coding  on  this  factor  1n 
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organization.  Unfortunately,  1t  1s  often  difficult  to  tell  from 
the  documentation  whether  those  Involved  1n  an  activity  constitute 
a  network  or  an  ad  hoc  grouD . 

State  and  regional  policy  forums  and  symposia  usually  have  an 
ad  hoc  part 1c 1pat 1on  depending  on  the  topic ,  but  may  Involve 
continuing  networks . 

Commun 1 cat 1 on  Mode.  The  third  facet  of  the  linkage  strategy  1s 
ths  mode  of  communication.  A  major  difference  in  communicat 1on 
approach  occurs  between  activities  that  are  organized  on  a 
state-by-state  basis  and  those  that  are  organized  regionally. 
Determining  which  1s  more  appropriate  will  depend  on  a  number  of 
considerations.  To  the  extent  that  states  within  a  region  have 
common  problems  and  Interests,  a  regional  approach  1s  feasible; 
where  there  are  considerable  differences  among  the  states,  dealing 
with  them  Individually  may  be  required.  There  1s  a  continuing 
tension  between  the  need  to  be  responsive  to  varying  needs  and 
contexts  and  the  need  to  bring  broader  perspectives  to  bear  on 
problems  that  are  rarely  unique.  Many  labs  have  opted  to  work  with 
the  State  Education  Policy  Seminars  (SEPS)  Jointly  sponsored  by  ECS 
and  IEL,  and  this  format  requires  a  state  approach.  In  other  cases 
labs  have  cooperated  with  the  Center  for  Pol 1cy  Research  in 
Education  (CPRE)  1n  organizing  regional  policy  symposia.  Aside 
from  meetings,  most  direct  services  such  as  those  provided  to 
chiefs  and  SEAs  are  organised  on  a  state  basis.  SEDL  has  made  a 
special  effort  to  provide  more  or  less  Identical  services  to  each 
state  in  Its  region,   but  to     organize  them  by  state,   not   by  region. 
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(Interview  with  Institutional  liaison). 

Many  types  of  communication  are  employed,  Including  meetings, 
reports ,  briefings ,  consu 1 ta tlons ,  and  products .  Meetings  in  thei r 
various  forms  (symposia,  forums,  conferences,  etc.)  generally 
1nvol ve  the  widest  array  of  part  ic i  pan ts .  Meet  ings  and  reports  in 
various  "Dunn  types"  (I.e.,  policy  Issue  papers,  policy  briefs, 
policy  news  releases)  are  common  to  almost  all  labs.  SEDL  1s 
noteworthy  for  its  frequent  use  of  briefings  for  state  personnel 
and  Its  attempt  to  use  an  electronic  bulletin  board  (later 
abandoned).  Both  FWL  and  NE/I  have  consulted  directly  with 
legislative  committees  on  specific  pieces  of  legislation. 
Pol 1cy  Improvement  Strategy 

The  services  offered  as  part  of  the  policy  Improvement  strategy 
are  shown  1n  Table  7.  (The  caveats  enumerated  for  Table  3  also 
apply  here.)  They  cover  the  entire  spectrum  of  KPU  activities.  (In 
this  table  an  MX"  1s  used  to  Indicate  presence  of  the  strategy 
component  1n  one  or  more  activities  or  projects.) 

Information  Services.  Clearly  labs  see  themselves  as  sources 
of  knowledge  1n  the  broadest  sense.  In  the  first  instance,  this 
takes  the  form  of  a  number  of  specific  Information  services .  These 
are  separated  1n  the  analysis  from  other  Improvement  activities 
because  they  are  primarily  capad ty-bu1ld1ng  functions;  they 
provide  an  Information  resource  that  facilitates  the  actual 
performance  of  policy  Inquiry.      Information  services  Include: 


o  Devel opment  of  several   types  of  databases 


o  Preparation  and  dissemination  of  reports  based  on 
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these  databases 
o  Provision  of  search  and  retrieval   services . 


Labs  may  either  use  their  own  resources  or  help  clients  find  other 
resources  in  or  outside  of  the  region. 


Table  7.     Profiles  of  Lab  Task  3     Policy     Improvement  Strategies, 
and  Policy  Stage  Emphasized. 

Profile  —  ----------------Ea^ 

Component  AEL       FWL     McREL  NCREL     NE/I  NWREL     RBS       SEDL  SEIL 

a7~pol  icy""  IMPROVEMENT 
1 .  Information 

a.  HB  Develop  XX  X  XX 

b.  OB  Reports       XX  XXX 

c.  Search/Retr     XX  XX 


2.   Policy  KPU 

a.  Research 

b.  Evaluation  X  XX 

c.  Anal/Briefs  XXXXXXXXX 

d.  Development  XXX 

e.  Tech  Assist  XX  XXX 

f.  Staff  Devel  X  X 

g.  Demonstration  X 

B.   POLICY  STAGE  A , F     A,F,E       F  F  F         A,F       I,E         F  F 

legend! 

A*   Policy  Improvement:   X  «  present 

B.  Policy  Stage  Emphasized:  Agenda,   Formulation,  implementation, 

Evaluation 


The  specific  nature  of  the  databases  is  not  described  in  detail 
in  the  documentation  reviewed.  In  many  cases  databases  consist  of 
materials  in  a  file  drawer  or  library  collection.  In  some  cases  a 
formal  content  analysis  of  the  document  has  been  prepared . 
Retrieval  and  analysis  are  often  manual  but  in  a  few  cases  files 
have  been  entered     in  a  computer  and  can  be     retrieved  and  analyzed 
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electronically.  Overlap  with  Task  1  is  suggested  by  the  inclusion 
here  of  databases  on  indicators  (education,  social,  demographic, 
economic  ,  etc . )  and  educational   issues . 

The  study  of  inf or mat i on  needs  of  state  pol icymaker s  by  the 
State  Policy  Consortium  found  a  great  interest  in  the  policies  and 
reform  initiatives  of  other  states  (Cohen  1985a).  Four  labs 
indicate  that  they  are  tracking  this  Information  for  states  within 
their  region  (FWL,  NE/I ,  NWREL ,  and  SEIL).  The  national 
associations  involved  in  the  State  Policy  Consortium  (see  above) 
have  collected  this  kind  of  data  from  time  to  time.  However,  for 
reasons  that  are  not  clear,  the  state  policy  coordinators,  meeting 
to  plan  cooperative  activities  under  Task  5,  rejected  the  idea  of 
all  nine  labs  cooperating  to  produce  this  database.  (The  " pol icy 
issues  matrix"  adopted  ..is  used  to  keep  track  of  policy  issues  on 
which  the  labs  themselves  are  working.  See  Policy  Domains  section 
below.  Only  SEIL  uses  it  to  track  state  reform  efforts.)  Given  the 
strong  interest  in  this  kind  of  information,  its  relevance  to  the 
Task  3  responsibilities  of  all  labs,  and  the  continuing  interest  of 
national  orgjmizat ions ,  it  seems  unfortunate  that  it  has  not  been 
possible  to  organize  a  national  system  that  would  track  state 
policies,  programs,  and  reforms  on  a  comprehensive  and  continuing 
bas is  . 

In  several  instances  there  are  databases  on  special  topics 
related  to  lab  programs.  Thus,  NWREL  has  a  regional  database  of 
information  relevant  to  the  education  of  at-risk  youth  in  the 
Northwest.       Other     specialized     files     include     those     on  service 
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organizations  and  consultants. 


These  databases     are  used     to  provide     both  reports 


of  general 


Interest  to  decisionmakers  throughout  the  region  and  to  prepare 
targeted  reports  for  given  states  or  even  to  local  districts. 
Thus,  McREL  reported  1n  1987  that  during  the  past  year  1t  had 
produced  a  national,   a  regional,   and  two  state  environmental  scans. 

Labs  typically  offer  search  and  retrl  e va 1  (and  sometimes 
synthesis)  services  to  chiefs  and  other  state  officials.  For 
example,  AEL  offers  to  conduct  searches  and  prepare  two  syntheses 
for  each  chief  1n  Its  region  each  yeer.  However,  a  dilemma  is 
inherent  1n  these  activities.  On  the  one  hand,  demand  for  such 
services  may  be  slow  to  develop  (as  AEL  found);  on  the  other,  too 
much  demand  will  strain  lab  resources,  and  labs  don't  want  to 
compete  with  general   Information  centers. 

Pol  lev  KPU.  Beyond  the  capacity-building  activities  of 
Information  services  are  activities  or  services  that  are  ways  of 
doing  (or  assisting  1n  doing)  policy  Inquiry.  Of  course  this  1s 
not  an  entirely  clear  distinction  in  that  doing  something 
undoubtedly  tends  to  add  to  the  capacity  for  doing  it.  But  the 
obverse  1s  not  necessarily  true;  it  1s  possible  to  build  capacity 
without  actually  doing.  (e.g.,  one  can  learn  to  do  arithmetic 
without  using  arithmetic  to  solve  problems.) 

Many  of  the  labs  have  used  conceptual  frameworks  developed  by 
W11 1 1um  Dunn  to  distinguish  between  pol 1cy  research  and  pol icy 
analysis  (Dunn  T986).  In  brief,  pol icy  research  responds  to 
problems  Identified  by  researchers,   collects  and  analyzes  new  data, 


ERIC 


40  j 


CH^PT  IV  State-Level   DMs  Page   IV- 1 6 

operates  in  a  long  time  frame,  and  uses  complex  methods.  Pol  icy 
analysis  responds  to  probl ems  identified  by  pol icy makers ,  and  uses 
available  information  and  simpl»  methods  in  a  short  time  frame. 

In  these  terms  only  FWL  conducts  policy  research,  although  two 
others  conduct  policy  evaluation,  which  can  be  considered  a  form  of 
policy  research.  In  1987,  FWL  conducted  a  research  study  of  the 
link  between  teacher  recruitment  and  retention  and  a  teacher 
information  system  in  California.  It  also  evaluated  the  Utah 
Career  Ladder  System.  RBS  assisted  the  District  of  Columbia  Public 
Schools  in  evaluating  a  carear-f ocused  dropout  prevention  strategy. 
For  FWL  and  NWREL  policy  evaluation*  is  a  source  of  contract  work 
that  operates  outside  of  the  OERI  scope  of  work. 

Dunn  has  elaborated  what  he  calls  the  ADD  model  of  policy 
analysis,  i.e.,  types  of  Analysis,  Development,  and  Dissemination 
(Dunn,  1986).  This  schema  would  be  useful  for  a  more  micro 
analysis  if  the  necessary  detailed  data  were  available  and  we  were 
able  to  use  specific  reports  or  projects  as  units  of  analysis. 
Since  this  is  not  feasible,  we  are  using  a  more  traditional 
Knowladge  Production  and  Utilization  (KPU)  framework  (Mason,  1982), 
but  introduce  the  Dunn  concept  of  policy  analysis  as  a  special  type 
of  research. 

All  of  the  labs  perform  policy  analysis  and/or  prepare  policy 
briefs.  The  Issues  examined  will  bu  dealt  with  below  in  the 
section  of  pol icy  domains .  Somet imes  the  papers  are  prepared  for 
presentation  at  a  policy  forum  or  symposium.  In  other  cases  they 
are       printed     and       distributed       to     selected       lists     of  state 
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policymakers.  SEIL  has  chosen  to  go  the  sub-contract  route  for 
doing  policy  analysis.  Agreements  have  been  reached  with  the 
Educational  Policy  Center  of  the  University  of  South  Carolina  and 
the  Center  for  Policy  Studies  at  Florida  State  University  to 
provide  on-demand  pol icy  analyses  and  alternative  pol icy 
configurations  for  state-level  decisionmakers  within  the  region. 
In  the  Dunn  framework,  pol icy  br ief s  are  shorter  versions  of  policy 
issue  papers;  labs  often  distribute  policy  briefs  as  newsletter 
inserts . 

A  limited  amount  of  development  is  undertaken,  RBS,  for 
example,  does  some  instrument  and  handbook  development  as  part  of 
Its  assistance  to  the  Implementation  of  state  school  improvement 
programs . 

Another  form  of  service  is  technical  assistance,  which  may  take 
the  form  of  reports  designed  to  assist  a  specific  client,  or 
in-person  consultation.  McREL,  NE/I ,  NWREL ,  and  RBS  are  most 
Involved  in  this  type  of  work.  For  example,  the  New  Hampshire 
Assistance  Center  of  NE/I  helped  the  Alliance  for  Effective  Schools 
(a  broadly  based  group  promoting  school  improvement)  to  develop 
plans  for  a  school  improvement  project  based  on  a  model  developed 
for  special  education.  Technical  assistance  is  a  source  of 
additional   contract  work  for  some  labs. 

Finally,  labs  provide  a  limited  amount  of  staff  development, 
and  in  some  cases  develop  training  materials.  McREL,  for  example, 
1s  conducting  a  job  analysis  of  the  knowledge,  skills,  and 
competencies     needed     by     state     agency     staff     to     prepare     for  a 
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systematic  training  program  1n  strategic  planning. 
Pol 1cv  Stage . 

As  indicated  earlier,  the  policy  process  is  a  social  activity. 
Mitchell  and  Dunn,  among  _chers,  have  pointed  out  that  the  policy 
process  goes  through  several  stages  and  continues  to  recycle 
(Mitchell,  1979;  Dunn,  ^986).  Their  fairly  elaborate  models 
suggest  that  different  kinds  of  policy  relevant  information  are 
most  appropriate  for  each  stage  of  the  policy  process. 

Table  7  characterizes  the  Task  3  efforts  of  the  labs  in  terms 
of  the  policy  stage  emphasized.  Labs  show  a  marked  preference  for 
the  early  stages  of  the  policy  process.  Pol 1cy  formulation  1s  the 
modal  stage,  and  several  are  also  active  at  the  agenda  setting . 
All  are  involved  in  the  latter  to  the  extent  that  they  share  the 
results  of  their  needs.  Identification  work  under  Task  1  with 
state-level  decisionmakers . 

The  clear  exception  to  the  overall  preference  to  the  early 
stages  1s  RBS,  which  appears  to  operate  almost  entirely  at  the 
pol icy  Implementation  and  evaluation  stages.  In  the  years  before 
the  current  OERI  contact  Pennsylvania,  New  Jersey,  and  Delaware  had 
all  adopted  ambitious  state  school  improvement  programs.  In  a 
sense  many  of  the  major  policy  decisions  were  already  made  and 
embodied  in  these  programs.  Consequently  RBS  chose  to  focus  its 
assistance  on  the  Implementation  and  evaluation  of  these  programs . 
Policy  Issues  and  Domains 

The  third  side  of  the  "strategy  cube"   is  the  Identification  of 
the  substantive  areas  of  program  work,  whether  labeled  "educational 
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need"  or  "policy  Issue. "  The  strategic  planning  design  for 
laboratories  requires  that  they  select  their  programs  and  projects 
through  a  process  of  studying  the  needs  and  resources  of  the  region 
(see  above ) . 

Fortunately,  as  part  of  work  under  the  state  policy  theme  of 
Task  5  (see  below) ,  a  common  classification  of  policy  Issues  has 
been  devised.  Using  this  classification,  a  "policy  Issues  matrix" 
has  been  established  as  an  on-Hne  database  pn  the  Source.  This 
database  consists  of  a  11st  of  50  policy  issues  for  which  each  lab 
Indicates  the  nature  of  Its  Involvement  with  the  Issue,  using  the 
following  code: 

0  Not  an  organizational   theme  or  policy  Issue  area 

1  An  emerging  policy  Issue  area  or  staff  Interest  area 

2  An  organizational   theme,   but  not  specifically 
Identified  as  a  pol 1cy  Issue  area 

3  A  short-term  or  one-time  state  policy  issue 

4  An  ongoing  Task  3  state  policy  Issue 

This  database  enables  labs  and  others  with  access  to  the  Source 
to  Identify  labs  that  are  working  in  specific  policy  arenas.  It 
also  enables  us  to  analyze  patterns  of  lab  activity  across  policy 
Issues.  (Note  that  1t  1s  not  limited  to  Task  3  activities.  See 
next  page. ) 

Less  fortunately,  the  classification  was  not  derived 
theoretically  and  thus  consists  of  a  "laundry  list."  As  such,  1t 
may  be  useful  for  searching,  but  has  little  analytic  value.  To 
copa      with     this       problem,     a      more     general       and  theory-based 
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classification  has  been  adapted  that  seems  to  have  categories  that 
are  mutually  exclusive  and  comprehensive .  It  was  developed  by 
Mitchell  and  is  found  in  the  FWL  proposal  (pp.  11-109-110).  (This 
classification  is  similar  to  but  not  identical  to  that  proposed  in 
Mitchell  and  Encarnatlon,  1983).  The  50  policy  matrix  categories 
are  mapped  into  the  seven  Mitchell  classes  along  with  one  of  our 
own.  Our  adaptation  adds  a  category  of  policy  Issues  defined  in 
terms  of  the  class  of  student  involved  (e.g.,  dropouts,  urban) 
rather  than  an  educational   issue  per  se. 

The  codes  used  to  record  lab  activity  present  another  probl em . 
In  the  present  context  we  are  Interested  in  Identifying  the  policy 
domains  of  lab  Task  3  activity.  Tabulating  the  incidence  of  code  4 
would  seem  tc  do  this,  but  only  1f  we  use  a  narrow  definition  of 
Task  3  activity,  namely  that  it  1s  an  "ongoing"  Task  3  state  policy 
Issue  interest.  In  a  number  of  instances  labs  have  undertaken  the 
study  of  a  policy  Issue  on  a  one-time  basis*.  Inclusion  of  code  3, 
Ma  short-term  or  one-time  state  policy  issue,"  would  seem  to 
provide  the  answer.  It  is  not  clear,  however,  whether  this  is 
restricted  to  Task  3  activities  or   includes  work  under  other  tasks. 

Table  8  uses  the  broad  definition  of  involvement ,  indicating 
the  number  of  "policy  matrix  issues"  each  lab  is  Involved  with  at 
either  the  3  or  4  level,  classified  into  the  more  general  policy 
domain  categories.  (Note  that  the  table  entries  are  numbers  of 
Issues     addressed,   not     the  involvement  levels.) 

Several  patterns  stand  out.  Two-thirds  of  the  policy  issue 
involvements     are     found       in       three       domains:       curriculum  and 


ERIC 


CHAPT  IV  State-Level  DMs 


Page  IV-21 


Table  8.  Number  of  Policy  Matrix  Issues  Addressed  at   Involvement  Level 

3  or  4*,  by  Laboratory  and  Policy  Domain. 

Policy   I—Laboratory-"-—"  ALL 

Domain  AEL     FWL  McREL  NCREL     NE/I  NWREL     RBS       SEDL  SEIL  LABS 


Bldg  &  Facilities 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

Curr  &  Instructlo 

1 

7 

7 

3 

1 

2 

0 

2 

1 

24 

Org  &  Governance 

0 

3 

1 

2 

1 

0 

2 

2 

1 

12 

Prog  Definition 

0 

1 

2 

2 

0 

0 

1 

0 

0 

5 

School  Finance 

0 

0 

1 

0 

0 

0 

0 

0 

1 

2 

School  Personnel 

2 

3 

5 

5 

3 

1 

4 

4 

2 

29 

Student  Type 

1 

6 

4 

3 

4 

2 

1 

0 

0 

21 

Student  Testing 

0 

0 

0 

1 

0 

0 

1 

0 

0 

2 

Total  Issues 

4 

20 

20 

16 

9 

5 

9 

8 

5 

96 

Involvement  Rank 

9 

1  .5 

1  .5 

3 

4  .  5 

7.5 

4  .  5 

6 

7.5 

NA 

Source;   Based  on  Regional   Lab  Policy  Issues  Agenda,  2/1/88 
*Lex/el  3  =  A  short-term  or  one-time  state  policy  issue 
Level   4  =  An  on-going  Task  3  state  policy  issue 

instruction,  school  personnel,  and  student  types.  No  attention  is 
given  to  "buildings  and  f ac i 1 i t ies , "  . and  practically  none  to 
"school  finance"  and  "student  testing."  Both  of  the  latter  are 
perennial  state  issues,  but  evidently  labs  are  not  perceived  as 
resources  for  their  analysis. 

The  labs  vary  markedly  in  number  of  issues  addressed.  Both  FWL 
and  McREL  address  twenty  different  issues,  FWL  in  five  domains  and 
McREL  in  six.  At  the  other  end  of  the  spectrum,  AEL  is  involved  in 
only  four  issues  in  three  domains,  and  NWREL  and  SEIL  in  five  each. 
Only  a  small  association  exists  between  the  number  of  issues 
addressed  and  budget,  level  (see  also  Table  3). 
National  Coordination . 

General .     Because  all   labs  have     Task  3  scopes ,   state  policy  is 
a  natural     area     in  which     to     expect     cross-lab  coordination.  In 
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addition,  important  national  resources  can  be  accessed  by  labs.  A 
state  policy  theme  was  indeed  identified  under  Task  5.  Some 
national  coordination  takes  place  in  connection  with  this  theme, 
and  some  outside  of   it . 

Labs  are  also  expected  to  coordinate  their  work  with  research 
centers  supported  by  OERI.  In  this  case  there  is  a  Center  for 
Policy  Research  in  Education  (CPRE)  located  at  Rutgers.  While 
several  labs  have  worked  with  CPRE  to  organize  regional  policy 
forums,  it  -'s  not  clear  that  they  have  made  use  of  research, 
conceptualization,  or  other  substantive  nesuits  coming  from  the 
Center . 

In  organizing  state  policy  forums  a  number  of  the  labs  have 
worked  with  SEPS  (State  Education  Policy  Seminars)  established 
jointly  in  30  states  by  the  Education  Commission  of  the  States 
(ECS)  and  the   Institute  for  Education  Leadership  ( I  EL ) . 

Labs  al:so  participate  in  the  national  scene  by  reporting  their 
work  at  the  meetings  of  national  professional  associations. 
Several  l^bs  provided  input  of  state  policy  data  at  the  request  of 
the  National  Governors f   Association ! 

Task  5,  State  Pol  icy  Theme .  Each  lab  was  required  to  set  aside 
funds  under  Task  5  for  collaborative  work  among  the  labs  and  with 
centers,  national  organizations  with  state  policy  interests,  and 
OERI.  A  theme  for  collaborative  work  in  state  policy  was  mandated 
in  the  RFP  by  establishing  a  network  of  Task  3  project  directors. 
This  group  has  met  several  times  in  the  first  two  years  and  the 
theme  will   be     continued  in  years  three  through  five     .   SEIL  is  the 
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lead  lab  for  this  theme,  and  all  labs  are  participating  to  some 
degree.  Several  national  organizations  have  been  represented  at 
meetings  of  the  network. 

Two  objectives  were  established  for  this  theme: 

o  To  provide     a  means  for  exchanging     policy  resources  and 


products 

o  To  enhance  existing  policy  support  systems  with  an 
emphasis  on  increasing  the  capacity  of  labs  as  well  as 
state  and  national  agencies  and  support  groups,  by 
f ocus ing  on  six  study  quest  1 on s : 

*  What  are  the  appropriate  ways  to  do  policy  analysis? 

*  How  do  we  assess  and  enhance  capacity  for  policy 
analysis  wi fch  states? 

*  What  is  the  nature  of  data  systems  to  assess  and 
support  policy  development? 

*  Can  we  develop  a  taxonomy  of  l  derlying  policy 
mechanisms? 

*  How  can  support  groups   relate  to  policymakers? 

*  How  do  we  devcalop  new  strategies  of  policy 
imp! ementat  ion? 


From  the  documentation  available  it  is  not  possible  to  quantify 
the  amount  of  collaborative  work  done  under  this  theme.  Scattered 
references  are  made  to  one  lab  providing  a  speaker  at  another  lab's 
policy  forum  or  making  policy  analysis  papers  available.  It  is  not 
clear  whether  any  policy  analyses  were  done  collaboratively. 

The  distinctlor  between  doing  and  capacity-building  has  already 
been  introduced.  The  principal  activities  accomplished,  and  the 
main  thrust  of  the  objectives  and  "study  questions"  that  guide  this 
task  theme,  are  intended  to  increase  the  capacity  of  the  labs 
themselves  and     of  their  collaborators     and  clients  to     undertake  a 
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more  systematic  and  Inquiry-based  policy  analysis  function. 
William  Dunn's  aforementioned  paper  (1986)  provides  a  conceptual 
framework  for  policy  inquiry.  A  second  document  by  Dunn  in 
collaboration  with  Richard  E.  Basom,  Jr.  and  Carl  D.  Frantz  and 
sponsored  by  NE/I  is  the  Educational  Pol  icy  Development  Training 
Handbook.  As  of  the  end  of  the  second  contract  year  only  an 
outl ine  and  one  prototype  section  had  been  completed . 

One  other  noteworthy  accomplishment     has  been  the  establishment 
of  a  "policy  issues  matrix'   to  describe  the  involvement  of  each  lab 
(all   programs)   in     selected  policy  issues.     This     database  was  used 
above  for  trie  analysis  of  policy  domains. 
Policy  Assistance  Configurations 

The  fact  that  it  was  not  feasible  to  use  the  project  or. 
activity  as  the  unit  of  analysis  and  our  method  of  highlighting  the 
"primary"  clients,  etc.  has  obscured  the  full  range  of  each  labfs 
activity.  It  will  be  useful  here  to  provide  a  thumbnail 
description  of  each  lab  Task  3  program  to  get  a  better  feel  for 
t ota 1   programs . 

Level  of  Effort .  Before  looking  at  the  individual  program 
configurations,  let  us  introduce  Table  9,  which  shows  each  labfs 
budget  for  Task  3  in  1986  and  1987.  The  RFP  specified  that  each 
lab  should  devote  10  to  20  percent  of  it's  program  effort  (i.e.. 
Tasks  2-5)  to  this  work.  Task  3  effort  expected  to  be  secondary  to 
the.  effort  for  Tasks  2  and  4. 

For  the  most  part,  the  effort  programmed  for  Task  3  was  within 
the  guidelines  and     on  the  high  side  of  the    range.     RBS  appears  to 
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have  committed  resources  well  above  the  guideline  level,  but  the 
figure  may  Include  some  funds  for  Task  2. 


Table  9.  Laboratory  Level  of  Effort  for  Task  3,  FY  1986-87,  and  Regional 
R&D  Organizational  Resources. 


 Fiscal  Year  1986 

Fiscal 

Year  1987 

R&0 

Orgs 

Lab 

No. 

Amount 

Task 

3 

Amount  Task  3 

No. 

Rank 

States 

Amount 

Per  State 

%* 

Amount 

Per  State 

%* 

** 

AEL 

4 

132,597 

33, 149 

1 1 

142,662 

35, 666 

13 

125 

8 

FWL 

4 

353  ,400 

88,350 

18 

352,745 

88, 186 

20 

303 

3 

McREL 

7 

235,838 

33,691 

21 

269,071 

38,439 

21 

176 

7 

NCREL 

7 

179,678 

25,668 

16 

89,700 

.12,814 

10 

552 

1 

NE/I 

9 

236,457 

26,273 

19 

269,575 

29,953 

18 

408 

2 

NWREL 

7 

349  ,662 

49,952 

13 

275 , 080 

39,297 

10 

114 

9 

R6S 

5 

583,375 

1 16,675 

28 

583,375 

1 16,675 

28 

291 

4 

SEOL 

5 

194  ,468 

38,894 

14 

272,975 

54,595 

20 

180 

6 

SEIL 

6 

120,913 

20, 152 

19 

123,024 

20,504 

15 

271 

5 

TOTAL 

54  2, 

386,388 

44, 192 

19 

2,378,207 

44,041 

17 

2,420 

NA 

*Percent  of  program  funds.  Tasks  2-5 
**Source:  Franks!  at  al  1579 


Just  what  can  be  accomplished  under  this  task  1s  a  function  of 
both  the  absolute  amount  of  money  available  and  the  number  of 
states  to  be  accommodated.  In  1987  the  absolute  amounts  ranged 
from  $120,000  (SEIL)  to  $583,375  ( RBS) .  The  number  of  states  or 
other  Jurisdictions  served  varied  from  four  (AEL  and  FWL) )  to  nine 
(NE/I).  On  a  per-state  basis,  the  range  1s  from  $20,504  (SEIL)  to 
$116,675  (RBS).  The  range  for  percentage  of  program  budget  1s  much 
smaller,  from  11.4%  (AEL)  to  27.8%  (RBS).  Of  course  there  1s  no 
requirement  that  the  same  amount  be  spent  on  each  state,  and  some 
act  1 v1 ties  are  reg1on-w1de  and  not  state-specific . 

Between  1986  and  1987  SEOL  made  a  significant  Increase  1n  Its 
Task    3     allocation      as     Its     thematic     work       reached     Its  final 
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made  by  NCREL  and  NWREL .  Rationales  for  these  changes  are  not 
available. 

Regional  R&D  Resources.  One  would  expect  that  lab  plans  for 
state  policy  assistance  would  be  tempered  by  the  availability  of 
resources  for  pol icy  analysis  within  state  government  and  in 
non-governmental  organizations.  Table  9  contains  a  rough 
Indication  of  the  distribution  of  R&D  resource  organizations  by 
region  as  they  existed  in  1981.  (While  the  numbers  may  have  been 
different  1n  1 986-87 ,  the  rank  order  by  region  was  probably  about 
the  same . ) 

NCREL  1s  a  new  lab  still  1n  a  developmental  stage  with  a  small 
budget  and  required  to  serve  seven  states.  NCREL  spent  only 
$25,668  per  state  in  1986,  and  even  this  was  reduced  to  $12,814  in 
1987.  On  the  other  hand,  the  North  Central  region  ranks  first  in 
the  number  of  R&D  organizations  in  the  region.  These  circumstances 
may  account  for  the  focus  of  the  NCREL  Task  3  program  on  state 
forums  t^^c  include  outside  experts. 

By  contrast,  NWREL  ranks  lowest  in  regional  R&D  resources  and 
has  the  largest  total  budget,  but  in  allocation  of  funds  to  Task  3 
it  ranks  third  on  both  total  and  per-state  bases. 

Further  comments  about  level  of  effort  and  R&D  resources  will 
be  made  1n  the  description  of  each  lab's  Task  3  "configuration" 
that  f ol 1 ows . 

AEL .  AEL  is  1n  the  lower  end  of  the  range  for  both  total 
dollars  available  for  Task  3  ($132,597  and  $143,662)  and  in 
percentage  of     total   budget  allocated     to  this  task     (slightly  over 


ERIC 


erJc 


CHAPT  IV  State-Level   DMs  Page  IV-27 

nine  percent).  However,  because  only  four  states  are  in  the 
region,  the  amount  per  state  is  close  to  the  average  (about  $35,000 
1n  each  year) . 

The  Task  3  program,  the  Policy  and  Planning  Center,  is  a 
reflection  of  AEL's  organizational  design  chat  establishes 
structural  interconnections  between  the  lab  and  major  state  level 
constituencies.  Focusing  on  Task  3  1s  potentially  misleading,  for 
Tasks  2,  3,  and  4  are  all  intended  to  assist  different  groups  of 
state-level  decisionmakers . 

AEL  begins  by  noting  that  the  educational  R&D  community  is 
marginal  to  the  world  of  educational  practice.  The  lab  is  viewed 
as  a  linkage  organization  designed  to  assist  in  bridging  the 
"theory-practice  gap.M  They  are  aware,  however,  of  the  research 
literature  failure  of  decisionmakers  to  use  research-based 
knowledge  and  the  inadequacies  of  strategies  that  rely  solely  on 
information.  Their  Intent  is  to  "maximize  long-term  involvement  by 
state  officials  in  activities  that  should  help  them  develop  a  more 
inquiry-based  approach  to  decisionmaking  and,  at  the  same  time, 
support  their  efforts  at  inquiry  with  easily  accessible  and 
relevant  information"    (AEL  Proposal    1985,   p.  125). 

The  program  Is  organized  Into  five  activities .  The  first  is 
designed  to  create  a  forum  of  the  region's  CSSOs .  The  chiefs,  all 
members  of  the  AEL  Board,  are  also  constituted  as  the  Council  on 
Policy  and  Planning.  As  such,  they  have  a  dual  role,  first  as  a 
committee  of  the  board  with  special  responsibilities  for  reviewing 
and     making  recommendations     on  the     lab  program ,     and  second     as  a 
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forum  for  the  discussion  of  regional  policy  Issues.  This  committee 
meets  before  the  board's  quarterly  meetings.  7he  first  role  has 
tended  to  overshadow  the  second,  and  in  the  second  contract  year 
onl y  two  Task  3  forums  were  held  .  A  formula  has  evol ved  for 
rotating  the  meetings  among  the  four  states  and  inviting  the  host 
chief  to  select  the  policy  topic.  He/she  also  has  the  option  of 
inviting  a  variety  of  state-level  policymakers  to  the  forum.  The 
lab  assists  by  preparing  special  Information  packets  and  pol icy 
briefs  and  commissioning  papers  by  outside  experts. 

The  second  ac t 1 v1 ty  is  an  annual  symposium  of  state  government 
decisionmakers.  The  topic  for  year  two  was  "The  Competitive  Edge: 
Preparing  Youth  for  Jobs  of  the  Future."  The  70  people  attending 
included  legislators,  state  board  members,  governors'  staff,  state 
voc  ed  advisory  council  members,  and  business  and  industry 
representatives.  In  the  future  the  annual  symposium  will  double  as 
one  of  the  chief's  forums. 

The  third  activity  is  intended  to  monitor  and  report  on 
selected  educational  trends  in  the  region,  but  1t  is  not  clear  that 
any  work  was  actually  accomplished  under  this  activity.  During  the 
second  year  a  design  for  accomplishing  this  task  in  FY  1988-90  was 
produced  under  sub-contract  by  the  Virginia  Policy  Analysis  Center 
at  the  University  of  Virginia. 

The  fourth  activity  is  to  provide  a  policy  Information  search, 
retrieval,  and  synthesis  service,  Including  linkages  with  national 
and  regional  organizations,  for  the  chiefs  and  other  government 
officials.     Eight     Issues  papers  have  been     published.     For  1988-90 
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activities  three  and  four  have  been  modified  to  de-emphasize  search 
and  retrieval  services  and  to  put  greater  effort  into  Issuance  of 
trend  and  policy  Issues  papers. 

The  fifth  activity  1s  to  prepare  "Policy  Briefs"  as  inserts  for 
AEL  f  s  newsl etter ,  The  Link.  Four  such  Inserts  were  prepared  in  the 
second  contract  year . 

In  sum ,  the  AEL  program  1s  designed  to  increase  the  inquiry 
orientation  of  the  chiefs  primarily,  and  other  state  leaders 
secondarily,  by  involving  them  1n  meetings  for  the  discussion  of 
policy  Issues  of  their  own  choosing  and  providing  information  and 
analysis  resources  to  support  these  activities. 

FWL.  Al though  the  Far  West  proposal  descr 1 bes  a  system  of 
matrix  management  that  has  a  Task  3  coordinator  providing  oversight 
for  activities  found  1n  each  of  four  programs,  the  Task  3  work 
reported  for  the  second  year  seems  to  reflect  only  that  labeled 
"State-Level  Policy  Support"  under  the  Policy  Support  Services 
Program . 

FWL  spends  more  than  $350,000  per  year  for  Task  3.  With  only 
four  states  1n  Its  region,  this  amounts  to  roughly  $88,000  per 
state.  However,  1t  is  a  heterogeneous  region.  California  1s  a 
very  large,  resource-rich  state,  while  the  other  three  states  he ve 
sma 11  popu 1  at ions  and  much  smal 1 er  resources .  The  program  1s  even 
larger  that  these  figures  suggest  because  the  laboratory  has 
undertaken  several  significant  non -federal  contracts  consistent 
with  Task  3  objectives. 

The  FWL  program     is  notable  for  Its  employment     of  field  agents 
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1n  each  state.  These  agents  have  a  variety  of  responsibilities: 
they  collect  needs-sensing  and  trend  information,  update  lists  of 
key  actors,  help  organize  SEP  seminars,  prepare  state-oriented 
inserts  to  policy  briefs,  and  prepare  white  papers  (personal 
communication  from  Paul  Hood). 

Probably  the  dominant  activity  for  FWL  is  preparing  policy 
briefs  and  issue  papers,  four  of  which  were  prepared  in  1987.  But, 
it  also  engaged  in  direct  consultation  with  state-level 
policymakers  in  a  relatively  rare  instance  of  involvement  in  the 
legislative  process:  it  worked  with  the  California  Senate 
Appropriations  Committee  to  develop  an  omnibus  school  reform 
measure.  The  lab  also  worked  with  the  state  directors  of  planning 
and  program  evaluation  to  explore  the  establishment  of  a  regional 
database,  an  idea  that  had  to  be  dropped  for  lack  of  funds.  In  the 
area  of  policy  research  and  evaluation,  the  lab  studied  the  Utah 
Career  Ladder  System  and  analyzed  the  link  between  teacher 
recruitment  and  retention  and  a  California  teacher  information 
system . 

McREL.     McREL     allocates  a  significant  portion  of     its  budget  to 

Task  3  (20-21%),   but  this  amounts     to  only  $33-38,000  per  state,  on 

the  average .     The  prog  ram  is  noteworthy  for  its  focus  on  the  theory 

and  methodology     of  strategic  planning.     Their     assessment  of  state 

education     systems     in     the     region     had     identified     a     number  of 

deficiencies  (Proposal   pp.    Ill-Task  3,   p  1-2): 

o  Lack  of  a  comprehensi ve     database  to  devel op  and  assess 
school   improvement  and  restructuring  proposals 

o  Lack  of  a  coordinated  planning  and  evaluation  mechanism 
O  4  J  H 
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o  Lack  of  policy  analysis 

o  Lack  of  opportunities  for     state  leaders  to  network  and 
to  get  to  know  the  perspectives  of  other  leaders 

o  Lack  of  opportunities  for  training  and  development 

o  Lack       of       1nf or mat 1onal     model s       for       rest ructur 1ng 
educat 1on  systems 

Further,  their  examination  of  the  context  of  the  region's 
educational  systems  had  revealed  a  major  shift  from  an  industrial 
to  an  Information-based  economy  and  focused  on  the  restructuring  of 
education  to  adapt  to  that  shift. 

Given  this  analysis,  McREL  adopted  a  strategy  for  Task  3  that 
emphasized  a  ca pac 1 ty-bu1l ding  approach  to  help  the  state  education 
systems  use  strategic  planning  to  adapt  to  environmental  press. 
Five  sub-tasks  1n  the  1985  proposal  had  been  consolidated  into 
three  by  the  second  year" 

First,  1n  response  to  the  lack  of  needed  Information  organized 
on  a  state  and  regional  basis,  the  lab  has  organized  and  developed 
a  variety  of  databases,  including  state  files,  educational  news 
publications,  education  Influence  publications,  and  statistical 
publications.  These  databases  can  be  searc hed  through  t  he  use  of 
key  words.  The  lab  publishes  and  distributes  reports  based  on  the 
databases  and  commissions  related  policy  Issue  papers  and  a 
periodical,   Pol 1cy  Notes . 

Second,  the  lab  organizes  an  annual  policy  conference.  One, 
held  1n  1987,  Invited  30  state  leaders  to  hear  national  experts  on 
Issues  that  appeared  to  be  strategic  rather  than  educational  Issues 
more     narrowly  defined.     I.e.,     human     resource  development,  state 
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economic  development,  school  finance,  and  school /business 
partnershl ps . 

Third,  technical  assistance  1s  provided  to  state  (and  local) 
education  policymakers.  The  lab  has  assisted  North  Dakota,  Kansas, 
and  Nebraska  to  develop  state  strategic  plans  and  provided  planning 
assistance  to  numerous  LEAs. 

NCREL.  In  Its  1985  proposal  (the  labTs  first  year,  but  a  year 
before  the  time  frame  under  review)  the  lab  had  proposed  an 
Information  and  networking  strategy  designed  to  provide  useful 
Information  to  legislatures,  SEAs,  and  local  school  districts. 
They  planned  three  types  of  meetings  1n  each  state  each  year: 
legislative  forums,  SEA  seminars,  and  policy  Implementation 
Institutes,  which  would  have  required  21  meetings  a  year  in  Its 
seven-state  regl on . 

However,  onl*'  $179,678  was  allocated  to  Task  3  1n  1986,  or 
$25,668  per  state.  In  1987  this  amount  was  cut  1n  half  ($89,700 
total,  or  $12,814  per  state).  By  1987  the  ambitious  schedule  of 
meetings  originally  planned  had  been  reduced  to  one  state  policy 
seminar  1n  each  state  plus  a  regional  policy  workshop  sponsored 
Jointly  with  the  Center  for  Policy  Research  1n  Education.  The 
meetings  featured  both  papers  prepared  by  experts  and  interaction 
among  various  stakeholders.  Activities  involving  database 
development  and  services,  technical  assistance,  or  training  do  not 
seem  to  have  been  used  for  this  task. 

NE/I .  Originally  the  lab  defined  its  Task  3  program  as  the 
theme      for'      Public       Policy        for       School       Improvement,  plus 
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policy-relevant  activities  under  three  other  themes,  and 
distinguished  between  regional  and  state-specific  projects.  In  the 
annual  and  assessment  reports  1t  is  difficult  to  pull  this  entire 
set  together,  and  it  1s  not  clear  whether  the  budget  allocation 
refers  to  the  entire  set  or  only  the  Public  Policy  Theme.  NE/I 
makes  an  average  commi tment  to  Task  3  1n  terms  of  budget  percentage 
(17.9%  and  18.2%)r  but  given  nine  jurisdictions,  the  amount  per 
unit  1s  near  the  bottom  of  the  range.  Consistent  with  its 
decentralized  structure,  the  lab  emphasizes  a  linkage  strategy 
using  state-level  forums,  although  some  regional  meetings  are 
sponsored . 

NWREL.  The  Northwest  Lab  has  a  relatively  large  budget,  but 
must  divide  Its  attention  among  seven  states  and  territories.  It 
made  a  significant  reduction  in  commitment  to  Task  3  between  1986 
and  1987  (see  Table  9).  No  rationale  for  the  reduction  seems  to  be 
available. 

All  of  the  states  in  the  Northwest  region  are  engaged  in  the 
implementation  of  long  range  plans  designed  to  achieve  higher 
levels  of  excellence.  NWRELNs  Task  3  activities  are  matrixed 
across  the  Lab's  organizational  units.  The  dominant  theme  of  these 
act  1 vi  ties  seems  to  be  the  improvement  of  database  management  and 
use  through  development  of  specific  packages  and  products,  and 
rel a ted  technical  assistance.  The  accompl Ishments  reported  for 
1987  include  development  of  a  special  regional  database  on  at-risk 
youth;  presentations  on  specific  policy  issues  at  meetings  of 
regional     groups ;     development     of     methodologies     for     developing , 
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managing,  and  using  databases  and  profile  Information  at  different 
decision  1  eve Is ;  development  of  an  expanded  form  of  the  School 
Improvement  Program's  School  Profiling  System  and  a  related 
workshop  package;  and  provision  of  consultation  and  technical 
assistance  to  state  agencies,  school  districts,  and  other  NWREL 
staff.  It  1s  not  clear  from  the  documentation  whether  the  Task  3 
effort  1s  targeted  at  the  state  level  or  whether  1t  Is  aimed  at 
assisting  local  districts  use  database  management  for  Implementing 
state  plans.  If  the  latter,  1t  would  not  seem  to  be  consistent 
with  the  objectives  of  Task  3. 

RBS.  RBS  stands  out  1n  Its  heavy  commitment  to  Task  3:  over 
$583,000  1n  each  year,  28%  of  Its  budget,  and  over  $116,000  per 
state.  (In  some  documents  1t  appears  that  the  State  Leadership 
Assistance  Project  1s  coterminous  with  Task  3,  while  in  others  it 
seems  to  Include  some  activities  from  other  tasks.) 

The  RBS  approach  to  Task  3  1s  unique  1n  that  1t  establishes  a 
specific  contractual  relationship  between  the  lab  and  each  state. 
For  each  state  the  lab  assigns  a  senior  staff  member  to  serve  as 
state  coordinator.  In  turn  each  CSSO  selects  a  senior  state-level 
dec 1s 1on maker  to  serve  as  the  RBS  state  1 ia 1son  person .  These  two 
develop  and  modify,  as  necessary,  a  written  agreement  describing 
how  RBS  will  work  with  state-level  decisionmakers  and  how  they  will 
participate  1n  cross-ntate  activities. 

Also  unique  is  the  lab's  emphasis  on  the  pol 1cy  Implementation 
and  evaluation  stages.  Although  the  lab  often  provides  planning 
assistance,     it     1s  generally     the     planning     of  Implementation  or 
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evaluation  activities  vis  a  vis  the  state  educational  improvement 
plan.  However,  some  assistance  1s  provided  each  state  in 
Identifying  new  policy  Issues  and  analyzing  policy  options. 
Although  the  emphasis  1s  clearly  on  working  with  each  jurisdiction 
separatel y ,   1 1  sponsors  at  1  east  one  reg 1onal   conference . 

A  broad  range  of  types  of  services  1s  provided  Including,  1n 
the  RBS  terminology,  planning,  planning  assistance,  resource  book 
revision,  training,  technical  assistance,  evaluation.  Information, 
research.  Instrument  and  procedure  development,  workshop 
development,  and  conference  management.  Tne  overall  Image  1s  one 
of  gap-fill 1ng  within  state  school   improvement  programs. 

SEDL.  Between  1986  and  1987  SEDL  made  a  significant  increase  1n 
Its  commitment  to  Task  3  as  Its  themes  reached  the  dissemination 
state  (see  Table  9).  The  lab's  posture  1n  Task  3  is  noteworthy  for 
1vs  strong  desire  to  avoid  taking  sides  in  political  battles 
Involving  conflicting  Interests.  It  specifically  eschews  the  role 
of  regional  problem  solver  and  opts  for  a  more  purely  informational 
role.  Further,  Task  3  1s  not  an  Independent  program;  rather,  in 
the  matrlxed  SEDL  system.  Task  3  activities  represent  the  targeted 
dissemination  activities  of  the  several  themes  around  which  SEDL's 
programs  are  organized.  The  three  primary  tactics  are  preparation 
of  briefing  papers,  forums  for  state-level  decisionmakers,  and 
one-on-one  briefings.  (An  electronic  bulletin  board  was  tested  but 
later  abandoned.)  SEDL  emphasizes  a  state-by-state  orientation, 
although  some  regional   meetings  are  held. 

SEDL 9 s  sel f -assessment     found  this  program  to     be  unnecessarily 
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rigid  and  non-respons1ve  to  many  emerging  needs  and  Issues. 
Consequently,  in  the  plan  for  1988-90  this  profile  1s  substantially 
changed.  A  new  theme  called  ED-AIDE  is  Identified  that  takes  full 
responsibility  for  Task  3.  It  1s  designed  to  identify  and  monitor 
emerging  Issues  and  to  anticipate  and  meet  information  needs  of 
decision-  and  policymakers,  and  to  respond  with  available 
Information  to  requests  that  requl re  quick  turnaround .  1 1  does 
continue  to  assist  the  theme  programs  in  working  with  state 
decisionmakers.  This  reorientation  1s  an  example  of  the 
constructive  use  of  sel f -assessment  to  make  program  changes. 

SEIL .  SEIL  has  a  relatively  small  budget  and  makes  a 
relatively  weak  commitment  to  Task  3.  Consequently  1t  stands  at  or 
near  the  bottom  of  the  range  for  level  of  effort.  Its  $21,377  per 
state  (8.5%  of  budget)  in  1986  moved  up  to  only  $24,369  per  state 
(8.8%  of  budget)  1n  1987. 

Educational  reform  is  the  dominant  theme  of  the  SEIL  Task  3 
program.  In  its  first  two  \ears  the  lab  established  and  maintained 
a  file  of  state  reform  initiatives  and  a  system  for  monitoring 
them.  It  also  operated  a  system  of  issue  identification  through 
environmental  scanning  of  publications  and  surveys  of  educational 
personnel.  It  held  a  regional  policy  forum  and  commissioned  some 
policy  analyses.  SEIL  is  also  the  lead  lab  for  the  Task  5  theme  on 
state  policy  under  which  an  electronic  database  of  policy  Issues 
addressed  by  each  lab  is  maintained.  This  program  reflects  the 
SEIL  style  of  sub-contracting  some  program  elements. 
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Comments  on  Task  3, 
A  wide  variety  of  linkage  strategies  were  used  in  assisting 
state-level  decisionmikers .  While  there  was  some  collaboration 
with  national  organizations,  most  work  was  intra-region .  Some  labs 
were  highly  focused  on  the  chiefs  and  SEAs,  while  others  worked 
with  a  broader  cross-sect  ion  of  state-1 evel  persons  and 
organizations . 

A  wide  range  if  improvement  strategies  was  used,  with  all  labs 
providing  policy  analyses  and/or  briefs.  With  the  exception  of 
RBS,   all   concentrated  on  the  earlier  stages  ov  the  policy  process. 

Of  eight  broad  policy  domains,  the  ones  in  which  most  lab  work 
was  done  were  curriculum  and  instruction,  organization  and 
governance,  school  personnel,  and  assisting  special  types  of 
students . 

At  the  risk  of  over-s i mp" - f i cat i on ,  the  dominant  role  of  each 
lab  in  its  Task  3  progr   ti  can  be  characterized  as  follows: 

o  AEL:  resource  for  policy  information  and  analysis  for 
CSSOs  and  SEAs  plus  organizer  of  regional   symposia . 

o  FWL:  resource  for  policy  research,  evaluation,  and 
analysis 

o  McREL:  builder  of  SEA  and  LEA  capacity  for  using 
strategic  planning  and  other  methods  for  the 
restructuring  of  education 

o  NCREL :  conference  organizer  for  state  pol icy  forums 

o  NE/I:   convener  and  facilitator  of  state  policy  forums 

o  NWREL:  resource  for  development  of  database  management 
systems  for  use  by  local  systems  in  implementing  state 
school   i mprovement  programs 
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o  RBS:     gap-filler  in     SEA     efforts     to  implement  school 
Improvement  programs 

o  SEDL:     dissemination     arm       of     lab     thematic  programs 
targeted  at  state  government  personnel 

o  SEIL:   monitor  of  educational   reform  issues  and  resource 
for  policy  analysis 

These  represent  substantially  different  approaches  to  bringing 
an  inqui  ry  orientation  to  bear  on  the  state  pol icy  process. 
Whether  they  have  resulted  from  careful  considerations  of  strategic 
options,  the  style  preferences  of  lab  personnel,  or  highly  adaptive 
responses  to  variations  in  regional  needs  and  resources  is 
difficult  to  ^ay- 
Review  of  these  programs  in  the  future  might  consider  the 
foil  owing  factors: 

o  The     balance  between     information     and  pol icy     anal ys is 
strategies 

o  The     bal ance       between     caoacity     building       and  doing 
strategies 

o  The  balance  between  meeting  the  needs  of  SEAs  and  those 
of  other  state-level  decisionmakers 

o  The*     bal  ance     between       state-by-state     act  ivi  ties  and 
regional  approaches 

o  The  balance  between  proactive  and  reactive  efforts 

o  The  balance  among  different  policy  stages 

o  Whether  the     program  serves     state-level  decisionmakers 
local  districts 


ERIC 


CHAPTER  V  TASKS  2  &  4 


Page  V-1 


CHAPTER  V 

PROVIDING  R&D  BASED  SERVICES  FOR  THE  IMPROVEMENT  OF  EDUCATION 
WITH  AND  THROUGH  EXISTING  ORGANIZATIONS: 
TASKS  2  AND  4 

Federal  Specifications 

According  to  the  RFP,  the  core  of  lab  work  was  1n  Tasks  2  and 
4.  The  two  are  treated  together  here  because  most  labs  found  it 
difficult  to  organize  their  work  according  to  this  task  structure. 
They  preferred  instead  to  define  their  programs  in  terms  of  some 
priority  need  and  then  identify  both  Task  2  and  Task  4  activities 
in  relation  to  that  need.  Some,  however,  labs  did  identify 
separate  activities  for  these  two  tasks. 

Given  the  importance  of  Tasks  2  and  4,  a  review  of  their 
characteristics  as  defined  by  the  RFP  is   in  order. 

Task  2  simply  stated  that  labs  should  "work  with  and  through 
existing  organizations  to  improve  schools  and  classrooms"  (p.  21). 
While  some  provision  was  made  for  working  directly  with  schools  and 
school  districts  in  exceptional  cases,  it  was  clear  that  an 
indirect     strategy     for     school     improvement  was     mandated     as  the 

dominant     linkage  strategy.       This  became     known  as     the   "with  and 

C 

through"  task. 

The  rationale  for  requiring  an  indirect  strategy  was  quite 
straightforward:  lab  resources  would  be  very  limited  and  all 
regions  had  at  least  some  important  school  improvement 
organizations  al ready  in  existence .  Therefore  some  1  eve rage  in 
achieving  school  improvement  could  be  achieved  by  collaborating  in 
various       ways       with       other       organizations       in       the  regional 
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infrastructure . 

Unfortunately,  there  were  also  some  countervailing 
considerations,  the  most  important  being  the  loosely  coupled  nature 
of  the  KPU  configuration  which  makes  impact  at  school  and  classroom 
levels  problematic.  In  addition,  the  willingness  of  other 
organizations  to  work  with  labs  has  to  be  constantly  tested  and 
negotiated.  Finally,  even  where  improvement  is  achieved,  the  lab 
contribution  might  be  invisible  or  difficult  to  separate  from 
others  1   contributions . 

This  dilemma  permeates  everything  that  labs  do  and,  indeed,  it 
might  be  said  that  the  central  challenge  faced  by  all  labs  is  that 
of  developing  a  linkage  stratagy  to  deal  adequately  with  these 
probl ems . 

Three  examples  of  appropriate  activities  were  cited  (RFP  pp. 
21-22) : 

o  Building  and  strengthening  organizational  support 
systems  for  i mprovement . 

o  Engaging  in  cooperative  local  improvement  initiatives 
with  other  service  improvement  organizations. 

o  Broadly  disseminating  the  results  of  research ...  to  the 
spectrum  of  audiences  interested  in  improving  schools 
and  classrooms . 

Task  4  requi  red  the  1 abs  to  "work  to  create  research  and 
development  based  resources  for  school  improvement"  (p.  25). 
Despite  ambiguity  introduced  by  the  term  "based,"  the  text  made 
clear  that  it  was  legitimate  for  labs  to  do  research  and 
development  as  well  as  to  compile  R&D  based  resources.  However, 
the  labs  were  encouraged  to     undertake  only  short  term  research  and 
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to  leverage  their  resources  by  taking  part  in  collaborative 
projects.  An  issue  to  be  raised  (but,  alas,  not  resolved)  is 
whether  the  popular  tactic  of  collecting  "promising  practices"  and 
disseminating  them  is  in  any  sense  an  R&D-based  tactic  rather  than 
a  craft  activi  y.  A  related  problem  is  that  craft  knowledge,  which 
has  its  origin  in  experience  rather  than  disciplined  inquiry,  seems 
to  be  accorded  the  same  status  by  the  labs  as  R&D-based  knowledge 
although  it   is  not  mentioned  specifically  in  the  RFP. 

Note  that  Task  2  corresponds  to  the  linkage  strategy  and  Task  4 
corresponds  to  <-he  improvement  strategy.  According  to  the  formu- 
lation presented  here,  all  lab  program  activities  require  both  a 
linkage  strategy  and  an  improvement  strategy.  So  it  is  not 
surprising  that  labs  found  it  difficult  to  divide  their  projects 
into  Task  2  and  Task  4  categories. 

Level   of  Effort 

The  -:entrality  of  these  two  tasks  was  underscored  by  the 
guideline  that  Task  2  was  to  constitute  from  40  to  55  percent  of 
the  program  budget,  and  Task  4  from  20  to  35  percent,  or  from  60  to 
80  percent  for  the  combined  tasks.  (One  cannot  add  the  two  upper 
limits  to  90  percent  because  Tasks  3  and  5  were  expected  to  take  20 
percent.)  The  actual  allocation  of  effort  for  the  two  tasks  in  FY 
1987   is  shown  in  Table  10. 

Generally  the  labs  allocated  between  two-thirds  and  three- 
quarters  of  their  program  budgets  to  the  combined  tasks.  On 
average,   44   percent  went  to  Task  2  and  27  percent  to  Task  4, 
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Table  10.     Amount  and  Percent  Budgeted  for  Tasks  2  and         FY  1987 

 Amount  Budgeted   Percent  of  Prog  Budget* 

Lcb  Task  2  Task  4  Total  Task  2       Task  4  Total 


AEL 

503,667 

374,182 

877,849 

44 

.7 

33 

.2 

78 

.0 

FWL 

809,220 

421  ,940 

1 ,231 , 160 

44 

.9 

23 

.4 

68 

.3 

McREL 

544,095 

308,416 

852,511 

41 

.9 

23 

.8 

65 

.7 

NCREL 

307,759 

372,243 

680, 002 

35 

.  1 

42 

.4 

77 

.5 

NE/I 

724,618 

321 ,033 

1 ,045,651 

48 

.3 

21 

.4 

69 

.7 

NWREL 

1,401,549 

837,028 

2,238, 577 

50 

.  0 

29 

.8 

79 

.8 

RBS 

770,058 

513,370 

1 ,283,428 

36 

.  7 

24 

.4 

61 

.  1 

SEDL 

630,697 

320,472 

951 , 169 

46 

.2 

23 

.5 

69 

.  '< 

SEIL 

377,544 

231  ,817 

609,361 

46 

.8 

28 

.7 

75 

.5 

ALL 

6,069,207 

3,700,501 

9,769, 708 

44 

4 

27 

.0 

71 

.4 

*Tasks 

2-5  make  up 

the  program 

budget . 

indicating  an  emphasis  on  the  linkage  strategy.  NCREL  is  an 
exception  to  this  pattern,  having  allocated  42.4  percent  to  Task  4 
and  only  35.1  percent  to  Task  2.  This  emphasis  on  creating  R&D- 
based  resources  may  seem  surprising  considering  that  its  region  has 
more  R&D  and  service  improvement  organizations  than  any  other 
region  (see  Table  9,  Chapter  IV);  but  the  lab  tends  to  create  these 
resources  by  subcontract  and  other  arrangements  with  outside 
agencies . 

Analytic  Approach 
As  stated  above,  every  lab  program  has  three  dimensions:  a 
linkage  strategy,  an  improvement  strategy,  and  a  substantive  focus. 
Task  2  essentially  defines  a  linkage  strategy  (work  with  and 
through  other  organizations),  but  lab  programs  listed  under  Task  2 
have  the  other  two  dimensions  as  well.  Similarly,  Task  4  defines 
an  improvement  strategy  (knowledge-based  resources),  but  lab  Task  4 
programs  also  have  the  other     two  dimensions.     Many  labs  structured 
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their  programs  in  terms  of  substantive  themes  (our  third 
dimension),  then  matrixed  the  activities  between  the  other  two 
dimensions . 

While  determining  which  of  the  three  dimensions  is  used  as  the 
primary  identification  of  a  program  may  be  somewhat  arbitrary,  it 
is  probably  based  on  which  of  the  three  is  chosen  as  the  point  of 
departure  in  the  planning  process.  If,  for  example,  working  with  a 
particular  set  of  partners  is  the  starting  point,  this  linkage 
strategy  becomes  the  program's  primary  identification.  Planning 
then  is  generally  done  jointly  to  select  a  substantive  focus  and  an 
improvement  strategy  and  to  further  refine  the  mode  of  linkage. 
If,  on  the  ocher  hand,  the  lab  starts  with  the  need  to  create 
certain  R&D  bcised  resources  in  a  substantive  area,  it  must  devise  a 
linkage  strategy,  for  bringing  these  resources  to  bear  on  the 
probl em . 

Our  task  would  have  been  greatly  simplified  if  it  had  been 
possible  to  use  the  project  as  the  unit  of  analysis  and  to  describe 
all  lab  work  in  terms  of  these  projects .  However ,  as  noted  above, 
there  are  a  number  of  difficulties  in  doing  this.  Some  lab 
activities  are  continuing  open-ended  services  that  do  not  lend 
t hemsel ves  to  a  project  structure.  Some  define  t hei  r  programs  in 
terms  of  abstract  functions  rather  than  programs  and  projects 
(e.g.,  McREL  Subtask  2.3:  ''Network  and  Broker  People  and 
Resources";  NCREL  Task  4,  "Extend  Pool  of  Available  R&D 
Information").  Some  labs  start  with  a  hierarchical  structure  of 
programs,   projects,     and  activities,   but     make  only  partial     use  of 
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that  structure  1n  their  annual   reports  (e.g.,  FWL). 

The  Inability  to  create  an  exhaustive  database  of  lab  projects 
means  that  we  cannot  perform  quant i  tat i ve  and  comprehensive 
analyses  of  lab  work  by  task.  For  example,  if  we  attempted  to 
analyze  work  done  with  intermediate  service  agencies  under  Task  2, 
some  of  labs  would  undoubtedly  rush  forward  to  say,  "Your  analysis 
is  incomplete  because  it  doesn't  show  our  work  with  intermediate 
agencies  under  Task  4.M  (In  Chapter  IV  we  chose  to  ignore  this 
problem,  knowing  that  not  all  work  with  state  pol icymakers  was 
found  under  Task  3 . ) 

As  a  result  we  are  eschewing  any  sophisticated  quantitative 
analyses  1n  favor  of  searching  for  an  understanding  of  lab 
strategies  more  qualitatively.  The  method  will  vary  somewhat  from 
section  to  section.  The  first  analysis  is  of  programs  designed 
around  a  particular  need  or  policy  issue  (i.e.,  the  educational 
focus  1n  our  three-part  schema).  The  example  chosen  is  programs 
for  improving  administrative  leadership.  First,  a  set  of  programs 
addressing  this  problem  will  be  Identified  and  described  briefly. 
Then  Issues  such  as  the  following  will   be  addressed: 

o  Are  there  variations   1n  how  the  problem  of  improving 
administrative  leadership  1s  defined? 

o  What  knowledge  base  1s  used? 

o  What  linkage  strategies  a  re  empl  oyed? 

o  What  Improvement  strategies  are  selected? 

The     following       sections     will       explore     new       typologies  of 
interorganizat 1onal       collectivities,       research     approaches ,  and 
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devel opment /demonstration  designs 


for 


programs 


for  improving 


admin  1st rat  1 ve  1 eadershi  p. 


Improving  Administrative  Leadership 


We  begin  with  a  set  of  programs  that  use  a  substantive  focus, 
improving  administrative  leadership,  as  the  point  of  entry.  At 
this  broad  level  seven  of  the  nine  labs  identify  a  need  and  define 
one  or  more  programs,  projects,  or  activities.*  A  listing  of  the 
relevant  work  units   is  found  in  Appendix  B. 

There  are  a  number  of  differences  in  the  structure  of  these 
work  units.  Some  are  single-level  and  others  multi-level.  In  some 
cases  the  highest  level  is  a  major  lab  program,  in  others  it  is  a 
single  project. 

Profiles  of  work  designs  for  administrative  leadership  for  the 
seven  labs  working  in  this  area  are  shown  in  Table  11.  Following 
is  an  examination  of  each  design  feature  by  looking  across  the 
table  horizontally.  Those  who  want  to  focus  on  the  overall 
strategy  for  any  lab  program/project  should  look  down  the  columns. 
Problem  Definition 

The  substanti/e  focus  of  the  work  represents  one  of  our  three 
strategic  dimensions.  The  seven  labs  represented  in  Table  11  have 
undertaken  work  in  the  general  area  we  have  called  "administrative 
leadership."     In     each  case  the  work  has  been  justified  as  emerging 

*McREL  planned  but  later  dropped  its  Administrator  Leadership 
Program.  It  did  provide  assistance  to  applicants  for  Leadership  in 
Educational  Administration  Development  (LEAD)  Center  grants .  While 
NCREL's  Professional  Development  Program  was  focused  on  teachers, 
it  also  has  implications  for  administrators. 
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labia  II      Profile  of  Lab  Prograee  Focuaed  on  Improving  Ad»1n  lit  rat  1  va  Leederehlp" 


Oealgn  Faeture 
PPOuA AM/Pfc6 J icf  ~ NAM  * 


Lift  DC  FIN IT ION 


•    I  HP  ROVE  HE  NT  STRATEGY 
1    RnMlM«t  Seaa 
•  Htmrch 


b  Prodwcta 


C  Practice* 


I.  Info  Servlcee 

•  Detabaaa  fttvaltpMnt 

b  Ka  porta 

c  Lab  nawalattor 

a  Newalatter  Inaarta 

a  Search  4  ratrlaval 


3    ftnowlaagc  Production 
a  Raaaarch 
b  Evaluation 
c    Policy  atuaiaa 
a  btvalo^Mnt 


SCHOOL  AONlNlSTRAT ION 
AMO  GOVERNANCE 


A    PRORtEN  OtFlNlTION 
How  Co  bulla  capec'ty 
for  1n«u1ry  in  aehooli 


■    IMPROVEMENT  STRATEGY 
1    Knewlodge  Oeao 
a    If facttva  achoola 
Oaa  of  coa#utar  for 


1- 


School  ho 
cat 1ona 


b.  Guieelinea  for 
aaaaaalnf  aaconaary 
rooaaial  aoftwera 

b.  Pract 1eee  developed 

1n  ftt.  RDa.  and  RD1S 

2.   Info  Servlcee 
Topical  raporta,  lab 
newalatter.  Inaarta 
1n  prof  aaaoc 
newelettore.  aaarch 
ana  ratrlaval 


l    Knowledge  Production 
Study  group  topical 
raporta 


SUPPORT  FOR  SCHOOL 
LEVEL  LEADERSHIP 


DEVELOP  AONINISERATOR 
LEADERSHIP  PROORAN 


PRODlEN  OCFIN1T10N 
Eff  ache  reeeerch  ralaaa 
ataa  far  principals 
aalatlan  af  principal 
Fallura  of  certification 
prograee  to  Keep  paca 


PRCSlEN  DEFINITION 
%9\  or  tch  odoa  will 
ratlra  1n  ■  yra 

wattling  aora  the 
affective  achoola  lit 


s   improvement  strategy 

1    Knowladga  Seaa 
a    Effective  achoola 
Pr  mm  Inatr  leader 


b.  Paar  Aaalatad 
Laaaarahlp  (PAL) 


Cmrmmr  ladder  opt  1 an a 


LE  ADC  ASH  IP  F0A  SCHOOL 
IMPROVEMENT 


S     IMPROVEMENT  STRATEGY 

1    Knowledge  Seaa 

1.  Sarf  lovannl 'a  ■  forcai 
nlcal .  huttn .  aducat 1on 
al.  ayebollc.  A  cultora 


2.  Info  Servlcee 


I  Knowledge  Product lo 
E.awlna  apedel 

topic*  1n  school 

loadorahlp 
Dov  auooor  ludirih 

1nat Itutea 


2    Info  Sarvleaa 


J    Knowledge  Production 
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from  the  need  assessment  process,  but  that  does  not  mean  that  the 
labs  are  working  on  identical  problems.  Under  this  broad  rubric  is 
considerable  room  for  variation  in  how  the  problem  is  defined  at 
more  specific  levels. 

There  is  also  tremendous  variation  in  the  amount  of  detail 
available  on  problem  definition  (as  well  as  other  program  design 
dimensions).  Some  labs  have  prepared  special  papers  (not  examined 
1n  this  review),   while  others  provide  only  a  paragraph  or  two. 

Generally,   there  are  several   broad  themes; 

o  Local  administrators  have  a  great  responsibility  for 
implementing  changes  resulting  from  the  reform  movement 
and  reform  in i t1at1 ves  of  the  states . 

o  There  are  important  bodies  of  research  on  school 
improvement,  instructional  leadership,  etc . ,  that 
administrators  need  to  become  f ami  1 iar  with. 

o  Schools  and  their  leaders  need  to  develop  a  culture  of 
i  nqui  ry  to  use  knowl edge- based  resources  in  t hei  r 
attempts  to  improve  schools. 

o  School  administrators  are  isolated ,  and  new  structures 
are  needed  that  put  them  in  comn,jnication  with  their 
peers  and  enable  them  to  access  knowleage-based 
resources  for  school   improvement . 

o  It  is  a  mistake  to  focus  exclusively  on  the 
principal's  role;  leadership  1s  provided  by  a  number  of 
roles  at  the  school   and  central   office  levels. 


These  are  not  mutually  exclusive  problem  definitions  and  might 
easily  be  strung  together  as  one  complex  rationale.  However,  the 
tendency  is  to  stress  one  or  a  few  of  these  rationales. 


Improvement  Strategy 

The     use  of     knowledge-based  strategies     is  a     given  for  labs. 
(Money  and     regulation  are     alternatives  available     to  governmental 
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entities.  See  Meson  1982.)  The  components  of  knowledge-base, 
improvement  strategies  are  the  knowledge  base,  information 
services ,  and  knowl edge  product  ion . 

Knowledge  Base.  There  are  distinct  differences  in  the 
knowledge  bases  used  for  the  improvement  strategy.  (Note  that 
knowledge  bases  are  also  *.ed  for  the  linkage  strategy.  See 
below.)  Here  the  focus  is  on  the  nature  of  the  knowledge  be 
transferred.  First  is  a  choice  to  be  made  among  research 
'  nowledqe.  knowledge  in  the  form  of  developed  products ,  and  that 
represented     by  existing     pract i< ss  some     other     form  of  craft 

knowl edge . 

The  main  bodies  of  research  knowledge  mentioned  are  those  on 
effective  schools  and  leadership.  Some  labs  prov  de  a  discussion 
of  one  or  more  of  these  knowledge  bases;  some  list  a  number  of  the 
generalizations  that  Save  emerged,  and  others  merely  name  the 
knowledge  base  used.  At  the  activity  level  some  specific  bodies  of 
knowledge  come  into  play   (e.g.,   sc hool -home-ccmmuni cat i ons  at  AEL) . 

A  distinction  cjh  be  made  for  products  between  those  that  are 
extant  and  those  that  are  to  be  developed  by  the  lab.  In  the 
former  category,  FWL  proposed  to  use  (and  further  refine)  Peer 
Assisted  Leadership  (PAL),  a  product  developed  in  prior  years.  In 
the  latter  category,  AEL  proposed  to  develop  a  document,  Guidelines 
for  Assessing  Secondary  Remedial  Software.  NWREL  planned  to 
develop  training  materials  for  use  with  school   network  personnel. 

Examples  of  practices  to  be  collected  and  reviewed  include 
"exemplary     programs"       (RB3) ,      "existing       performance  assessment 
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systems"   (,SEDL),   and   "career   ladder  options"    ( FWL)  . 

Information  Services .  It  nay  seem  strange  to  see  the  category 
"information  services"  under  improvement  strategy  since  this  would 
seem  to  be  inherently  a  linkage  strategy.  However,  the  front  end 
activities  involved  in  information  services  are  appropriate,  i.e. 
database  development  and  the  preparation  (in  contrast  to  the 
dissemination)  of  reports,  newsletters,  inserts,  briefs,  etc.  based 
on  knowledge  bases.  Database  development  may  be  difficult  to 
distinguish  from  knowledge  bases  used  (see  above).  The  term  is 
used  to  refer  to  organized  and  manipulable  knowledge  bases. 

AEL  provides  a  range  of  information  services,  including  writing 
topical  reports,  preparing  topical  pieces  and  inserts  for  the  lab 
newsletter,  preparing  inserts  for  the  newsletters  of  administration 
professional  associations,  and  search  and  retrieval  services  for 
regional  administrators.  (These  activities  correspond  to 
development  in  the  Dunn  ADD  model  for  policy  analysis  (Dunn  1987). 
SEDL  compiled  a  database  on  performance  assessment  systems  and 
prepared  reports  based  on  it.  It  is  noteworthy  that  only  two  of 
the  seven   labs  chose  to  use  information  service  strategies. 

Knowledge  Production .  Knowledge  production  can  take  the  form  o 
research,  evaluation .  pol icy  studies ,  or  development .  SEIL 
expected  its  activities  in  the  first  t*o  years  would  lead  to  the 
identifying  needs  for  future  research.  NE/I  nrcposed  two  specific 
studies,  one  of  central  office  leadership,  and  another  of  teachers 
as  school  improvement  leaders .  FWL  and  NWREL  organized  and 
developed  training    materials  for  institutes  and     NE/I   prepared  for 
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publication  a  Directory  to  R&D  Resources  for  School  Improvement 
Leadership . 

It  is  often  difficult  to  distinguish  between  the  improvement 
and  linkage  aspects  of  a  given  effort.  For  example,  in  organizing 
a  leadership  institute,  the  instructional  content  constitutes  the 
improvement  strategy  while  the  organization  of  the  institute  (e.g., 
wnom  to  invite  from  what  organizations,  whether  to  organize  it  on  a 
state  or  regional  basis,  whether  to  use  large  group  instruction  or 
organize  subgroups  by  roles  or  some  other  criterion)  constitutes 
the  linkage  strategy. 
Linkage  Strategy 

The  three  components  of  the  linkage  strategy  are  knowledge  base 
interorganizational   arrangements,   and  communication  mode. 

Knowledge  Base.  The  knowledge  base  for  the  linkage  strategy 
consists  of  bodies  of  knowledge  concerning  the  most  effective  means 
of  knowledge  dissemination ,  implementation ,  and  ut i 1 ization .  It 
can  take  the  forms  of  research  or  ordinary  kn  ™i  edge ,  products,  or 
practices/craft  knowledge . 

Documentat  ion  of  the  1 inkage  knowledge  base  tended  to  be  thin 
or  absent  in  the  material  describing  these  programs.  This  area  was 
covered  in  the  original  proposals  under  "lessons  of  research  and 
experience  in  terms  of  impl i cat ions  for  effective  strategies  to 
address  [each  task]"  (RFP  p. 36).  Because  it  probably  applies  to 
all  programs,  it  is  not  repeated  for  each.  The  citations  in  Table 
11  are  taken  from  both  the  proposal  introductory  material  and 
program/project  documentation . 

A  » 
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Research  cited  as  the  basis  for  linkage  strategies  included  the 
General  Purpose  Dissemination  Assistance  (GPDA)  Study  (Louis  et  al , 
1 984 )  ,  the  Dissemination  Efforts  Support  ing  School  Improvement 
(DESSI)  Study  (Crandall  et  al ,  1983),  Rogers'  conceptualization  of 
adoption  stages  (Rogers,  1962),  open  systems  theory,  and  others. 
The  only  example  of  ord i na ry  know! edge  cited  in  association  with 
this  program  was  knowledge  of  the  region  (AEL),  although  all  labs 
provided  this  ki  nd  of   kn owl  edge  in  other  sect  ions . 

For  linkage  knowledge  products ,  there  is  again  the  distinction 
between  existing  products  and  those  to  be  developed.  FWL  proposed 
to  use  and  further  refine  its  previously  developed  Peer  Assisted 
Leadership  (PAL)  product.  (PAL  was  also  mentioned  above  as  part  of 
the  improvement  strategy  knowledge  based,  assuming  that  PAL 
contains  both  substantive  knowledge  and  a  linkage  strategy.)  It 
further  proposed  to  develop  a  trainer  of  trainers  capability  and  to 
design  summer  leadership  institutes.  NE/I  took  the  route  of 
compil ing  a  di  rectory  of  extant  school  improvement  1 eadershi  p 
resources.  NWREL  proposed  to  design  network  and  collaboration 
models  in  one  activity  and  develop  draining  processes  for  training 
school  network  personnel  in  another.  SEIL  proposed  to  use  products 
developed  by  two  other  labs  and  centers  (FWL's  PAL  and  the  former 
Texas  Center's  Concerns  Based  Adoption  Model)  and  develop  its  own 
training  modules. 

Similarly,  practices  can  be  existing  or  planned.  AEL  noted 
that  it  had  a  good  deal  of  experience  with  practices  growing  out  of 
its     work  with     several   N I E-sponsored     dissemination  programs:  RDx 
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(R&D  Exchange),  R&D  Interpretation  Service  (RDIS)  and  RS  (Regional 
Services),  a  claim  other  older  labs  might  make  as  well.  NE/I 
planned  to  develop  an  Action  Guide  for  School  Improvement  (probably 
a  blend  of   improvement  and  linkage  knowledge). 

Interorganizational  Arrangements ,  Possibilities  for  national 
col laborat ion  lie  chiefly  in  the  improvement  strategy,  mainly  in 
developing  the  various  knowledge  bases.  Linkage  is  inherently  a 
i-egional  function  at  the  service  delivery  end,  although  there  are 
also  possibilities  of  national  collaboration  in  terms  of  reviewing 
the  knowledge  base  for  a  linkage  strategy  and  developing  linkage 
models.  Several  labs  list  other  labs  and  centers  as  national 
collaborators,  but  few  details  are  provided.  Regional 
col  1 aborators  include  SEAs,  professional  associations,  institutions 
of  higher  education,  principals'  academies  (with  varied 
sponsorship),  and  study  groups.  Clients  included  both  service 
improvement  organizations  (SIOs)  and  service  delivery  organizations 
(SDOs) . 

Eoch  lab's  configuration  of  relationships  with  collaborators 
and  clients  is  summarized  by  categorizing  its  interpretation  of  the 
" w^ th  and  through"  strategy .  Focusing  on  the  SIO  as  the  sole 
client  represents  a  "pure"  indirect  strategy.  The  approach  of  NE/I 
and  NWREL  is  indirect  in  that  they  treat  SIOs  as  primary  clients 
and  assist  them  in  implementing  programs  with  SDO  personnel.  RBS 
works  with  SEAs,  ISAs,  and  LEAs .  Its  work  with  large  metropolitan 
school  .  districts  can  be  considered  "with  and  through"  in  that 
central   offices     of   large  districts     function  much  like     SIOs.  FWL 
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also  works  with  the  central  office  of  a  major  urban  district,  not 
only  as  a  client  but  also  as  a  collaborator,  in  developing  and 
testing  products  for  use  in  its  own  district.  On  the  other  hand, 
AEL  sees  SDO  administrators  as  its  clients  and  state  professional 
associations  as   its  channels  of  access  to  them   (i.e.,  sponsor). 

Communication  Modes .  Virtually  all  labs  organize  their  prireary 
activities  by  state,  although  they  held  some  regional  conferences. 
The  dominant  service  strategy  is  staff  development.  Variation 
occurs  in  whether  new  networks  are  organ  zed  or  existing  structures 
(e.g.,  principalship  academies)  are  used;  whether  new  linkage 
training  is  designed  for  SIO  personnel;  and  whether  the  lab 
provides  information  or  training  to  SDO  personnel  or  assists  or 
supervises  SIO  personnel  in  providing  such  assistance. 
Conclusion  to  Improving  Administrative  Leadership 

Our  method  has  necessarily  broken  lab  programs  into  pieces. 
Let  us  try  for  a  more  holistic  view.  These  programs  are  all 
focused  on  improving  knowledge  and  skills  of  a  particular  role 
group:  mostly  building  administrators,  but  including  central  office 
staff  and  others  in  many  cases.  There  appear  to  be  two  main 
approaches  to  the  improvement  strategy.  One  is  to  start  with 
research  literacure  and  to  develop  training  packages.  The  other  is 
to  col lect ,  review,  and  package  particular  administrative 
practices.  The  principalship  academy,  either  pre-existing  or  newly 
formed,  is  the  most  popular  vehicle  for  linkage.  Most  labs  use  an 
indirect  s'-.^ategy ,  training  the  staffs  of  SIO  agencies ,  and 
sometimes  working     with  them  to  implement     training  programs.  Most 
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are  organized  by  state  rather  thar.  by  region.  It  does  not  appear 
to  be  an  area  of  significant  national  collaboration. 

While  use  of  inservice  training  is  traditional,  two  aspects  of 
most  programs  incorporate  the  findings  of  recent  research .  One  is 
the  recognition  that  the  need  for  leadership  resides  not  in  a 
single  role  but  a  combination  of  roles  at  both  the  building  and 
central  office  levels.  The  other  is  that  single-shot  training  is 
only  marginally  effective  and  that  more  lasting  effects  can  be 
obtained  by  involving  trainees  in  a  continuing  network  and 
providing  various  support  services. 

We  now  turn  to  a  more  fine-grained  analysis  of  the 
interorganizational  arrangements  used  as  part  of  the  linkage 
strategy  in  Task  2  and  Task  4  programs. 

Linkage  Strategy;  Types  of  Interorganizational  Arrangements 
Conceptual  Approach  / 

In  moving  to  a  focus  on  the  linkage  strategy,  it  will  be 
necessary  to  shift  methodology.  In  previous  analyses  we  have 
examined  three  aspects^of  the  linkage  strategy:  the  knowledge  b,3se, 
communication  mode,  and  interorganizational  arrangements .  However , 
the  "with  and  through"  strategy  was  perhaps  the  most  salient 
innovation  in  the  lab  RFP  design,  and  interorganizational 
arrangements  made  by  labs  to  implement  this  design  feature  warrant 
a  more  fine-grained  analysis.  Understanding  the  nature  and 
variations  of  this  indirect  strategy  is  crucial  to  designing  the 
next  round  of  contract  awards . 
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The  field  of  Interorganization  theory  has  been  developing  for  a 
number  of  years  as  an  offshoot  of  open-systems  theory  (Negandhi, 
1975).  It  has  been  studied  in  health  management  among  other  fields; 
outside  of  education  (S.  Mason,  1979).  In  education  the  present 
author  prepared  a  multi-award  RFP  issued  by  NIE  for  studies  of 
interorganizational  arrangements  that  resulted  in  several 
ground-breaking  reports  (Huberman  et  al ,  1981;  Yin  and  Gwaltney, 
1981). 

The  interorganizational  collectivity  (IC)  has  been  proposed  as 
the  basic  unit  of  analysis  (Van  De  Ven  et  al ,  1975).  Note  that  not 
all  relationships  constitute  collectivities,  e.g.,  a  lab  and  an 
organization  receiving  one-way  communications.  The  relational 
properties  of  ICTs  have  been  examined  from  two  perspectives:  (1) 
the  dimensions  of  interaction  or  exchange  between  organizations 
(e.g . ,  formal ization ,  intensity,  reciprocity ,  and  standardization) ; 
and  (2)  the  mechanisms  for  coordination  between  organizations 
(e.g.,  mediated  or  unmediated;  domain  consensus,  complementarity  of 
resources,  homogeneity  of  structure,  mutual  awareness,  and 
stability  between  the  organizations   in  the  exchange  relationship). 

Unfortunately,  documentation  available  for  this  study  does  not 
perm  this  level  of  analysis.  However,  it  would  be  helpful  if  we 
could  get  a  clearer  description  of  the  differant  kinds  of  ICs 
developed  by  the  labs.  Four  kinds  can  be  differentiated  by 
observing  two  different  factors.  First,  does  the  collectivity  have 
a  single  or  multi-purpose?  Second,  is  the  collectivity  limited  to 
two     organizations   (i.e.,     a  bi-lateral     arrangement),   or     are  more 
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than  two  organizations  involved?  The  combination  of  these  factors 
yields  four  kinds  of  ICs.  (See  Figure  7).  Of  course  our  maanings 
for  these  terms  do  not  necessarily  correspond  tc  those  used  in  the 
labs'  reports.  The  reports  being  examined  make  many  references  to 
"networks"  in  particular,  but  this  term  seems  to  have  different 
referents .     The  intent  here  is  to  use  four  terms  and  give  them  more 
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Multi-Lateral 


PARTNERSHIP 
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Figure  6.     Types  of  Interorganizat ional  Collectivities 


precise  meanings. 

We  can  take  the  classification  system  several  steps  further. 
First,  we  need  to  note  the  lab's  relationship  to  the  IC  in 
question.  In  some  cases  the  lab  is  simply  a  member  of  the  IC.  In 
other  cases  it  is  not  a  membe-  but  stands  in  the  relationship  of 
service  provider  to  a  client  IC.  Adding  the  membership  factor  to 
the  four  types  of  IC  yields  eight  types  of  IC  configurations,  as 
shown  1n  Figure  7 . 

Previously  we  had  noted     that  the  educational    infrastructure  is 
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Figure  7.     Types  of  Lab/Interorganizat ional  Collectivity 
Conf i  gurat  i  ons 


made  up  of  three  kinds  of  organizations,  KPOs ,  SIOs,  and  SDOs  (see 
II-1.)  For  present  purposes  KPOs  and  SIOs  are  combined  and  labeled 
SIO. 

Analysis  of  Lab  Program? 

In  Table  12  the  four  kinds  of  ICs  appear  as  the  column  heads. 
Not  all  relationships.,  constitute  ICs.  It  is  very  difficult  to 
define  the  boundary  between  interorganizational  arrangements  that 
constitute  collectivities  and  those  that  are  too  evanescent  to  be 
counted,  but  activities  involving  one-way  communication  from  the 
lab  to  some  organization  are  not  shown .  However ,  the  stub  of  the 
table  shows  the  types  of  organizations  the  lab  is  related  to  and 
its  role  in   relation  to  them. 

A  number  of  lab  programs,  projects  and  activities  are 
classified  in  the  cells  of  this  table.  No  claim  is  made  that  this 
table  is  compl ete  or  compr ehens i ve .  Many  projects  or  ot.ier  work 
units  are  no  doubt  missing  because  it  was  not  possible  to  work  out 
a  system  for  classifying  everything.  The  goal  is  to  examine 
projects  in  several   different  cells  to  gain  a  clearer  understanding 
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of  what  these  different   linkage  arrangements  mean  in  practice. 

Despite  this  disclaimer  I  will  hazard  two  generalizations. 
First,  the  collaborative  (multi-purpose,  bi-lateral)  seems  to  be 
the  least  popular  form  of  IC.  The  agreements  that  RBS  has  drawn  up 
with  each  SEA  1n  its  region  (which  apply  primarily  to  Task  3)  fall 
1n  this  category.  Similarly,  the  relationship  between  FWL  and  the 
California  State  University  (CSU)  covers  a  range  of  activities.  In 
fact  the  two  organizations  overlap  in  that  the  Southern  Service 
Center  operated  by  FWL  is  shown  as  a  unit  in  the  lab  table  of 
organization.  Ac  the  bottom  of  the  chart,  the  NWREL  Rural 
Networking  Program  is  really  a  three-level  arrangement  and 
therefore  classified  as  "mixed."  The  lab  provides  support  services 
for  a  number  of  SIOs  (presumably  separately),  .  hich  1n  turn  provide 
services  to  a  network  of  rural  schools.  Perhaps  the  lab/SlO 
relationships  would  be  better  categorized  as  partnerships  and  SIO 
rel ati  onshi  ps  as  cl 1en t  networks . 

The  second  generalization  cautiously  advanced  is  that  there  are 
far  more  single-purpose  arrangements  (partnerships  and  consortia) 
than  m^  1 1 i-purpose  (col laboratlves  and  networks).  This  seems  to 
point  to  the  desirability  of  flexible  e  -angements  for  responding 
to  shifting  needs  and  opportun 1 t 1es 

ICs  with  Lab  Member.     The  top  half  of   che  table  contains   ICs  in 
which  a  lab  1s  a  member     of  the  collectivity.      It   is  undertaking  an 
activity  jointly  with  one  or  a  series  of  organizations  on  a  more 
less  equal   footing.     Variation  occurs   in  terms  of  whether  the  other 
organizations  are  SIOs,     SDOs  or  mixed,   whether  the     activity  has  a 
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single  or  multiple  purpose,  and  whether  the  relationship  is 
bi-lateral   or  mu 1 1 i -1  a t era  1 . 

There  were  z*  number  of  Coses  of  par  tnershi  ps  between  labs  and 
SIOs.  A  frequent  activity  was  joint  sponsorship  of  a  conference 
with  a  research  center.  RBS  reports  working  on  research  studies 
jointly  with  the  Maryland  and  Pennsylvania  SEAs .  It  had  another 
partnership  wit,  the  Center  for  Instructional  Research  and 
Curriculum  Evaluation  (CIRCE)  at  the  University  of  Illino-.s.  The 
FWL/CSU  relationship,  already  noted  at  the  institutional  level, 
shows  up  again  as  partnerships  for  specific  projects. 

Although  business  corporations  are  not,  strictly  speaking, 
SIOs,  one  program  involving  corporations  is  placed  in  the  SIO 
partnership  cell.  NWREL  worked  with  several  such  corporations  in 
its  Automated  Workplace  program  to  get  a  more  accurate  idea  of  the 
work  environments  that  students  would  be  moving  into. 

There  was  one  case  of  a  partnership  with  an  SDO:  FWL's  work 
with  Clark  County,  NV,  on  the  project,  "Promote  District  Options 
for  School  Improvement." 

The  consortium  may  be  the  most  frequent  form  of  lab  membership 
in  an  IC.  Individual  themes  under  Tasi*  5  would  be  the  clearest 
exampl e :  three  or  more  cc-equa 1  organizations  working  together  on 
one  topical  theme.  Similarly,  joint  lab  sponsorship  of  CSAP, 
(Communication  Services  Assistance  Project)  at  CeDAn  is  a  cross-lab 
activity,   operated   in  this  case  by  a  third-part  SIO. 

NWREL  has  three  projects  involving  multiple  SIOs.  In  cne,  SEAs 
provide     software     evaluations     for     a     database     operated     by  the 
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Information  Center  on  Application  of  Technology.  In  another,  a 
meeting  focused  on  Technological  Literacy  for  All  was  attended  by 
both  subject  matter  and  teacher  organizations.  And  in  a  third,  it 
worked  with  SEAs ,  ISAs,  and  IHEs  on  the  Collegia!  Teacher  Training 
Project . 

Labs  are  also  involved  in  consortia  with  SDOs.  RBS  r.acie  a 
study  of  10  high  schools  working  jointly  with  the  Mid  Atlantic 
Metropol i  tan  Counc  i 1  (composed  of  SDO  administrators).  NC9EL 
established  a  consortium  to  sponsor  a  study  of   induction  programs. 

In  the  "mixed  consortia"  category,  SEIL  operates  the  Software 
Evaluation  Exchange  (SEED),  apparently  similar  to  the  NWREL 
project,  but  involving  both  SEAs  and  LEAs  as  sources  of 
evaluations.  FXL  worked  with  a  Dropout  Task  Force  in  Phoenix,  AZ , 
with  both  the  LEA  a.  d  ..community  representatives.  It  also  operated 
an  Outcome-Based  Education  project  in  Utah  in  conjunction  with  both 
thJ  Utah  SEA  and  state  ISA?. 

Continuing  across  the  top  half  of  the  table,  we  have  already 
noted  the  paucity  of  lab  col laborat 1ves .  Lab  networks  are  also 
relatively  scarce.  The  Urban  Education  Network  is  somewhat 
difficult  to  classify.  It  is  operated  by  three  labs,  so  there  is  a 
lab  network  at  that  level.  Sut  as  a  whole  it  is  better  classified 
in  the  lower  right  box  as  a  "client  network,"  since  the  labs 
provide  support  for  SDO  members  of   the  network. 

CI  lent  ICs .  Al though  not  Task  2/4  projects,  state  advisory 
committees  and  liaison  committees  operated  by  a  number  of  labs 
might     be  considered     client  networks     of  either     the  SIO     or  mixed 
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variety.  RBS  works  with  four  networks,  three  at  the  SIO  level  and 
one  at  the  SDO  level  .  In  the  former  group  are  the  Maryland  Council 
of  Assistant  Superintendents  and  the  Mid-Atlantic  Metropolitan 
Counci 1  (the  five  largest  LEAs  in  the  region )  ,  being  counted  as  SIO 
personnel  here  because  centra  1  off  ices  of  large  districts  function 
like  SIOs;  and  the  Labor-Management  Cooperation  Network.  In  the 
latter  category  is  the  Rural  Schools  Exchange.  McREL  operates  a 
rural  network  and  a   LEAD  Center  network. 

Improvement  Strategy;  RD&D  Approaches 
We  would  also     like  to  develop  a  more     f ine-grai«>cd  analysis  of 
some  of  the  improvement  strategy  categories. 
Research  Approach 

In  previous  analyses  we  have  used  a  breakdown  of  the  research 
approach  into  res<'^ch£  evaluation  .  pol  icy  analysis  ,  and  planning  . 
In  Table  13  thL  categories  appear  in  the  stub.  For  each  of 
these,  a  further  differentiation  can  be  made  in  terms  of  the 
primary  source  of  data,  i.e.,  primary  data ,  secondary  analysis .  and 
interaction  documentation .  These  categories  appear  as  column  heads 
in  the  table.  The  first  two  of  these  are  straightforward.  The 
third,  "interaction  documentation,"  needs  some  explanation.  Labs 
hold  many  meetings  with  other  groups  and  individuals.  Frequently 
these  are  "working  meetings"  rather  than  listening  to  speakers. 
When  peopl e  share  ideas  and  interact  at  these  meet  ings ,  a 
documentation  of  what  occurs  i  s  often  made  that  constitutes  an 
intellectual   product   termed  "interaction  documentation . " 
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Table  13.  UprovtMnt  Strategy:  Classification  of  Sol     octod  Task  2/4  Lab  Programs/Projects  by  Rosoarch  Approach. 


Rosoaroh  Approach 


-—Prime  ry  Source  of  Data  ------ 

Primary  Data  *  Socondary  Analysli 


Interaction  Document at 1on 


A.  AppHod 
Rosoarch 


8.  Evaluation 


C.  Policy 


Planning 


RBS:CSIP/Appl1ed  Ros/Pol1cy  Studios 
M1d  Atl  Council  study  of  10  H  Sens 

NM  4. St  Ros  on  Classroom  Assessment 
throo  studios  colloct  primary  data 

NM  4. Si  Toa  Turnover  1n  Rosorvatlon 
Schools 

NE/It  Loadorshlp  for  Sch  Impr: 
Study  of  Urban  High  Schools 

FML:  Study  of  toa  recruitment  & 
rotontlon  1n  CA 


NM  4.S  Ros  on  CI •■■room  Assessment 

On a  study  1s  synthosis  of  ros 
NM  4.19s  Sch  Improvement  Ros  Synth 
NCRELi  rov  of  ros  on  stratoglos 

for  Improving  Instruction 
NCREL:  10  "Interpretations  of  ros 

on  toachor  roles"  &  4  Intorps  of 

caso  study  research 
NCREL:  24  pa par ■/monograph  on 

dimensions  of  thinking 
NCREL:  Rov  of  lit  on  Incentives 

for  personnel 
AEL:  Anal  of  longlt  DB  on  family 

conditions  &  studont  achievement 
AEL:  Oemog  Study  of  Rural  Smal 

Schools  and  Districts 
McREL:  Toachor  Demand  &  Supply 


SEIL:  Tracor  study  of  SEED  (subcon) 
RBS:  Paper:  Exemplary  SD  Practices 

Related  to  Info  Collection  &  Uso 
McREL;  Reader  Response :NcREL  Update 
RBS:  Studios  of  state  mandatod  m1n 
competency  testing  1n  PA  &  NO; 
Study  of  MD  HS  Orad  Requirements 
FML:  Eval  prof  dev  ctr  1n  NV  co 

Eval  caroer  laddor  syst  1n  UT 
Eval  CSU  Summer  Bridge  &  Inton 
s1vo  Learning  Experience  Prog 
The  Effectiveness  of  Study 


NM  2.1:  Qtr  software  analysis 
reports 

NM  2.4:  Item  &  Test  Info  Ctr: 
Consumer  Guides  &  Guide  to  Item 
Banks 


AEL: 

Groups  as  an  R&D  Methodology 

SEIL:  Toachor  labor  market  studios 

SE 1 1  :  Longlt  study  of  tea  c*^t 
RBS:  Appl  Res/Pol1cy  Studios*:  Strat 

Planning  Studio*  1n  LEAs  '*  sens; 

Coord  of  Ed  &  Soc  Servlcas  1n  PA 


NM  4. IB:  Effective  Voc  Ed:  Uso 
strategic  planning  to  work  w  LEAs 
toward  now  directions  1n  voc  od 

McREL:  North  Dakota  Stato  Plan 
for  Technology 


SEIL:  Supply  Side  of  Toa  Lab  Mkt 

RBS:   3  position  papers  for  Pfi  lag 


NW  4.12:  Profile  of  Pacific  Schs 
NM  4.15:  Tho  Automated  Morkplaco: 

synthesis  of  previous  research 
NM  4.10:  Eff  Voc  Ed:  lit  search 
NE/I:  Loadorshlp  for  Sch  Impr:  soc 

analysis  of  2  sch  1mpr  studios 
NCREL:  Rov  of  lit  on  SD;  dov  frame- 
work for  planning  SD  progs 
McREL:  various  strat  plan  projs 


SEIL:  Model  for  tea  rosoarch  on 

writing  (subcontract) 
NCREL:  Invitational  seminar  on 

itratogles  for  Improving  1nstr 

will  produce  mats  for  summer  1nst 
AEL:  Classroom  Instruction  Prog: 

Study  group  reports 


RBS:  CSIP/Org  Eff /Sec  Sch  Impr: 

Papor:  Sec  Sens  *  Central  Office 
NM  2.5:  Reg  conf  on  Colloglal 

Staff  Dov  (no  proceedings?) 
NM  2.12:  Regional  Nets  for  Sch  Imp 


Reports  of  policy  forums 


NM  2.7:  Rural  Networking : tuptrvlsi 
&  monitor  plan  &  dov  of  col lab 
arrangomenta  botweon  nets  t  SlOs 
NM  2.17:  Stato  plans  for  working 

with  and  through  SIOs 
NM  4.4:  Technology  Forecast  Panel 
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The  reliability  of  coding  lab  programs  and  projects  into  the 
cells  of  this  table  may  not  be  high,  but  the  typology  may  still 
have  heuristic  value  in  illustrating  a  fairly  wide  variety  of 
research  approaches  and  methodologies  used.  Again ,  no  claim  is 
mad_e  that  this  table  represents  a  complete  and  comprehensive 
classification  of  lab  activities . 

While  no  attempt  to  review  all  of  the  work  found  in  each  cell 
is  being  made,  a  few  comments  are  in  order.  Examples  were  found 
for  every  cell  of  the  table.  Collection  and  analysis  of  primary 
data  is  still  an  approach  used  by  labs.  While  there  is  no  way  of 
quantifying  and  comparing  the  level  of  effort  fo^  the  three 
columns,  it  appears  that  most  labs  are  more  involved  in  secondary 
analysis  rather  than  the  analysis  of  primary  data.  In  addition,  in 
a  number  of  cases  involving  primary  analysis,  the  work  is  being 
done  by  a  subcontractor  rather  than  by  lab  personnel.  Interaction 
documentation  constitutes  an  important  form  of  knowledge  production 
for  labs. 

The  evaluation  category  may     include  some  projects  not  actually 
funded  by     OERI;    it     is  not     always  easy  to     tell   whether     the  work 
being  reported   is   inside  or  outside  the  OERI  contract. 
Development /Demonstration  Approach 

Development  and  demonstration  are  also  knowl edgs-based 
improvement  strategies,  but  they  cannot  be  subclassif ied  in  the 
same  way  as  research  approaches.  The  categories  used  in  the  stub 
of  Table  14  are  of  a  mixed  bag.  Devel opment  is  divided  into  two 
types,   that  done     by  the  lab  alone  and  that     done  jointly  with  some 
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other     organization.       Promising     practices  a  knowledge-based 

approach,  but  it  is  based,  at  least  in  the  first  instance,  on  craft 
knowledge,  not  research  knowledge.  We  will  investigate  this 
strategy  in  more  detail  below.  Finally,  Demonstration  involves 
implementation  ar.d  operation  of  an  innovation  on  site,  usually  but 
not  always  a  local  school,  to  document  and  illustrate  the 
feasibility  and  effectiveness  of  the  innovation.  Demonstration  is 
a  permissible  exception  to  the  "with  and  through"  linkage  strategy 
when  SDOs  are  involved  that  permits  the  lab  to  retain  "hands  on" 
experience. 

The  column  heads  of  the  table  differentiate  types  of  materials 
as  student  materials ,  teacher  materials ,  trainer  materials .  and 
administrator  materials.  This  is  probably  the  least  reliable 
classification  of  all  because  it  is  frequently  difficult  to  tell 
for  whom  the  materials  are  intended.  Projects  involving  "program 
descriptions"  are  generally  classified  as  "administrator 
materials,"  although  the  programs  might  well  be  oriented  toward 
teachers  or  trainers. 

Again,  no  claim  is  made  that  this  table  is  comprehensive;  in 
addition,  generalizations  are  hazardous.  It  would  appear,  however, 
that  the  focus  is  on  student  materials  less  often  than  on  other 
types  of  materials.  This  represents  a  sharp  contrast  to  the  former 
focus  of  older  labs  when  the  primary  improvement  strategy  was 
curriculum  development. 

When  development  is  involved,  it  appears  that  labs  are  more 
likely  to     proceed  on   their  own     than  to  engage  in     joint  activity. 
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Table  14. 


I.prov-ent  Strategy:  Cl.e.lf felt Ion  of  Solect.  d      L.b  Took  2/4  Progreae/Projoct.  by  fJav.lopaent/Deeon.trstlon  Approech. 


Type'of ~5ov«1opoont~ 
0Monttr«t1on 


Student  Materlole 


*  ~  "  Typo  of  Kter1ole-----~----~~»Z-lZZ»lZZ:iZ 

Toochor  MstsMsIs  Trolnor  tutorials 


Adalnlotrotor  Motorlolo 


LeDoretory 
Oovolopoont 


NH  2.2:  Too  Ctr  for  Deao  ft  Trng: 
Col loot Ion  of  nardwars  fc  oof  toon 


RSS:  Spool si  Populet1ona~Sch 

Iaproveeent  Modol 
NH  2. It  Trng  Ctr  tor  Clsssrooe 

Asseseeent  (oloo  T  of  T  ft  pro) 
McRELt  Moth  ocopo  ft  ooquonco  for 

rural  high  schools 
McREL r  Toctlco  Toochor  Monuol 
NCftELs  Options  handbook  on 

strstoglos  for  Instr  1epr 


I.  Joint  Dovslopoont 


NE/I i  Modules  for  Thinking  Skills 
Progree  (Jt  w  Harvard  prof) 


SEIL:  Quids  to  Pvt 'Sector ~Ra»ourca 

for  Principal  Ef f oct1 vonoss 
SEILt  Effoctlvs  Math  K-S:  workshop 

eodel,  handbook,  vldoo  taps 
RtSi  Organizing  for  Sac  Sen  Oov 
NH  4. 7 i  Ros  tesed  Sch  Iepr 
NH  4.11:  Eff  Voc  Editrng  eotsrlsT 
NCRELt  Prof  Govt  Manual  for 

ataff  dov  planning 
NCAELt  Modola/lndlcatora  of  instr 

loado^ahlp 
NCRELi  Ros  synth  en  too  ad 
FNLt  Outcoaa  toaod  Edt  Ca a a book. 

Modala  of  Xnatr  Org 
AEL:  Clsssra  Xnatr  Prog*  Devi 

Turnkoy  Training  Aotlvltloa 
McRELi  Mom  to  Tooch  Toochora 


SEXLi  2  clustsrs  of  eodulee: 

Coopotonclos  of  High  Parf  Pra 
RSS  i  Spoc  Pops  Sch  Xapr  Modal 
NH  2.7:  Rural  Networking*  Trng 
aota  for  SXOs  ro  rolsi  in 
dovsloplng  rural  nato 
NH  2. St  Trng  Ctr  CR  As a as a :  trng 

aotorlols  for  principal* 
NH  4. St  Ada  Guide  for  Toa 

Turnovar  in  Rosorvstlon  Scha 
NH  4.13:  Sch  Xapr  Ros  Synth:  Oov 
electronic  coaauMcot  1on  eyetoa 
RSSt  Xnetltutlonel  Anelyalet 

Directory  of  Inetruaenta 
McRELt  Ed  loadarahlp  trng  siodules 
McRELt  Planning  guide  for  1ap1 


NH  4.1ft  The  Au toasted  Horkplsce 
dsv  corporste  Mentoring  ft  field 
pleceeent  progroa  («  boa  col lobs) 

FHL  3. It  Eff  Suppt  tag  Teoa.  w/LA 
dov  ft  teat  ;re1n1ng  prog 

PHLi  Devi  ft  teat  Teaching  for 
Scientific  Literacy 

McREL:  ASCO  tope  on  etreteglc 
planning 


NH  2. St  Colleglel  Tee  Tmgt  Mentor 
Teacher  Handbook  (with  SXOs) 

FHL  3. It  w/Lo*  Angolss  SO.  dov  3 
sets  of  resource  aate  for  aentor 
teaching 


C.  Proa1a1ng  Prectlceo 


SEILt  SEED  (Software  Evol  Exchange 

eee  Tracer  Study 
NH  2. It  RICE  deteboee  on  ooureewere 

ivaluatlone  (Jt  w  SEAe) 
NH  4.14:  Proa  Prece  for  At  Rlek  V 
McRELt  Prairie  Hlnde 


NH  2.4 t  Xtaa  ft  Teat  Info  Center 
NH  2. ID  Eff  Prectlce  In  Indian  Ed 
NH  2.12:  Reg  Note  for  Sch  Xapr 
NH  4. It  Coaputer  ft  Curr  Studlee: 

ceeee  of  Integrating  eoftwere  ft 

currlculua 
NH  4.12:  Pacific  Eff  Practices 
NH  4.13:  Sch  Iapr  Raa  Synth t 

Exeaplsry  Practices 
NE/I t  Idsntlfled  print,  prog  ft 

hurt  it    resources  on  6  toplce,  ft 

reeource  b1bl 1ogreph1es 
NCRELt  Handbook  of  options  for 

evaluating  coaputer  applicative 
NCRELt  Collect  ft  col lata  info  on 

cutting  edge  eppllcetlone  of  tech 

to  etudente  et  rlek  ft  HOTS 
NCRELt  Collect,  study  ft  snslyzs 

SEA  ft  LEA  prectlceo.  polldee. 

proge  on  peraonnel  incentlvea 
FHL  2. It  Outcoaa  teeed  Ed  producte 

school  prof 1 loo  ft  resources  d1r 


RISt  LORE  ( Leader eh1p  for  Org 
Renewal  ft  Effect)  w/Ph11o 

RtSt  Sch  0  Eff  Audit  (w  NJ  Sch  too 
Assoc) 

NH  2.7t  Rural  Networking:  Oov  rur 

networking  aodela 
NH  4.12  Pacific  RftO  Oetabaae 
AEL t  Reg  Llelaon  Ctrt  Model  of 

hoee-achoo-coe  partnarahlpa 

w/Norfolk  coaaunlty 


SEDL:  Theae  t:  Applying  Technology 

to  Sch  Iapr  ??? 
NH  2.5:  Colleglel  Tee  Trng:  Search 
for  PPs  for  induction  ft  long 
tore  prof  dov  (w  SlOe) 
NH  4.18:   Eff  Voc  Ed:  study 

ff  prectlceo  at  ech  eltee 
NE/I t  Tee  Dov:  Guidebook 
NCRELt  Prof  Devt  project  in  2 

atetee  to  ID  diatlnctlve  SD  proge 
FHL  3  1:  Eff  Suput  Beg  Tea,  w/  CSu 
dov  ceeebook.  Close  to  the  Cleera 
AEL i  Prof  Prep  ft  Met  VA  ft  HV. 
directory  of  too  trng  reeourcee 


D.  Dsaonstrstlc 


f  ti  Too  Ctr  for  Deao  ft  Trng: 
of  herd ward  ft  soft war*  st 
headquartere  ft  in  field 
NH  4.14:  PP  for  H1  Rlek  Y:  Help 

aa lac tad  LEAa  plan  alt  learn  envli 
McRELt  Technology  Deeons tret Ion 
SD  DAT 


NC/It  Agreements  with  •  SEAs  ft 

11  LEAa  for  deao  eche.  At  Rlek  V 
FHL  1.2:  Self-D1r  Learn  1n  Sc1 
AEL:  School  Eiccellonce  Sites  (SES) 
McRELt  ACCESS:  Preperstlon  for 
SAT  end  ACT 


SEDL:   Iapr  Sch  ft  CR  Productivity* 
outcoaes  for  trng  310  facilitator 
S  sites  w  SIO  psrtnsrs 

NH  2.13:   Pacific  Locsl  Csp  Sldgt 
Trsin  trslnsrs  ("local  cad raa * ) 

PHL  3. It  Eff  Suppt  tag  Teat.  w/CSU 
Support  ft  docueent  pilot  doaos  1n 
clinical  euperv1e1on  of  beg  teee 

McREL:  Tactics  training  for  MO 
Loadarahlp  Acedeey 


SEDL i  Theae  At  Partnarahlpa  H1th  I 

Per onto,  tualnaea.  ft  Coaaun1t1ee 
SEDL  t  Theae  C.  Tee/Ada)  Psrfasnce 

Aeeeeeaent  Syateas 
RSS:  Coapendlua  act  1apr  indicator 
NH  2.S-.  Sch  1apr  thru  Eff  Tes 

Evslt  Five  Kay a  to  Growth 
NH  2.lSt  Need  ID:  trng  sets  on 

problea  enelysls 
NH  2.14:  Pvt  Sector  Networking: 

Llnkege  aodale 
NE/I t  Tee  Ed  Refora  Deteboee 
NE/I  j  LaaderaMp  for  Sch  Iapr: 
Directory  of  Reeourcee 
|  PHL  Lit  Profile  of  etete 
sssssseent  progrses 
PHL  3.1  Eff  Suprort  teg  Tsee  w/CSU 

Policy  ft  Prog  Cessbook 
AELt  tov/Adat  atudy  group  producte 


RBSt  tec  Sch  Iapr :  deao  sites. 

working  w  teeas  f r  cent  off 
PHL  3.  St  Proeote  Diet  Option  a 

for  ech  iapr.  w/  Clerk  Co  NV 
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On  the  other  hand,  the  promising  practices  strategy  is  almost 
always  an  approach  requiring  work  witn  other  organizations. 

Approaches  to  Staff  Development 

The  last  two  sections  have  proviced  an  overview  of  lab  1 inkage 
and  improvement  strategies  and  subtypes  of  interorganizat ional 
collectivities,  and  research  and  development/demonstration 
approaches.  We  would  now  like  to  get  a  more  holistic  view  of 
contrasting  strategies . 

While  all  laboratories  identified  staff  development  as  an 
important  educational  focus,  there  was  considerable  variation  in 
definition  of  the  problem  and  improvement  and  linkage  strategies 
employed.  Because  they  divide  naturally  into  three  subgroups, 
profiles  of  selected  of  staff  development  programs  appear  in  three 
separate  tables:  15,  T6 ,  and  17.  Table  15  shows  three  labs  that 
selected  a  trainer  of  trainers  approach  mixed  with  an  important 
knowledge  production  component.  Table  16  shows  three  labs  that 
also  had  a  knowledge  production  component  but  combined  it  with 
information  dissemination  rather  than  training.  Finally,  Table  17 
shows  the  other  three  labs  that  adopted  three  different  strategies: 
a  nearly  pure  knowledge  production  approach  ( FWL) ,  a  networking  and 
inf or mat  ion  dissemination  approach  (McREL),  and  a  comprehensi  ve 
approach  (NWREL).  Note  that  these  are  selected  programs,  chosen  to 
reflect  variations  in  approach.  No  claim  is  made  that  the  program 
selected  for  any  lab  necessari 1 v  reflects  its  total  approach  to 
staff  devel opment . 
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Tabic  IS.    Sal act ad  Approach**  to  Staff  Davalopaont:  Knowladga  Production      and  Training  Tralnara 


ERIC 


Program/ 

Project 

Name 


1gn  Feature  AEL 


Problem 
Definition 
(Educational 
Focus) 


B.  Improve- 
ment 

Strategy 


C.  Linkage 
Stratagy 
1 •  Col labor- 
ators  and 
clients 

2.  Services 


3.  Provision 
for  2nd 
t1sr 

D.  Impact 
1st  level 
2nd  Hvtl 
arc1  laval 


E.  Ramarks 


4bj 


assroom  Instruction  Prog 
»  Training  opportunities 
b.  TURNKEY  TRAINING* 


Cooperative  School  Improvement 
Instructional  Improvement 
.TURNKEY  TRAINING 


PROBLEM  DEFINITION 
Need:  to  Improve  teaching 
a  learning  1n  region 
3  principles  of  action: 
Work  with  and  thru 
Pr1v1de  RftD-besed  Info 
Provide  opportunities  for 
teas  to  Increase  kn 


A.  PROBLEM  DEFINITION 


B.   IMPROVEMENT  STRATEGY 
o  Using  methodology  of  RDIS 
synthesize  research  on  st 
dev,  math  ft  sc1,  and  oral 
ft  written  comm  ft  reading 
o  Produce  4  training 
pkgs  1n  06  and  9  1n  87 


C.   LINKAGE  StRATEGY 

1 .  Col laborators/cl 1ents 

o  NEA  state  affiliates  are 
sponsors;  trainers  *  SDO 
personnel  "charged  with 
staff  development" 

2.  Services 

o  Training  workshops 


3.  Second  tier 
o  Ad  hoc 


D.  IMPACT 
o  120  1n  6  workshops  1n  67 
o  231  by  II  of  above 


E.  REMARKS:  Part  of  larger 
program*  *A1so  provides 
turnkey  training  to  NEA's 
Mastery  1n  Learning  project. 


RBS 


8.   IMPROVEMENT  STRATEGY 
>  Produce/refine  training 
packages  1n  3  content  areas 
thinking  skills,  elementary 
excel lence.  and  Instruction* 
supervision . 


SEIL 


C.  LINKAGE  STRATEGY 

1,  Collaborators/clients 
o  Collaborators:  SIOs 

o  Clients:  staffs  of  LEAs , 
SIOs,  prof  assocs,  ft  SEAs 

2.  Services 

o  Turnkey  training 


3.  Second  tier 
o  Ad  hoc 


>.  IMPACT 

o  "...the  use  of  materials 
was  more  piecemeal  than 
programmatic" 


E.  REMARKS 


EFFECTIVE  K-5  MATHEMATICS 
REMEDIATION 


|A.  PROBLEM  DEFINITION 
1 .  Need  for  more  teachers 
with  four  competencies 
Goals: 

Communicate  theories 
and  strategies  of 

Instruction 
Train  trainers  of 
trainers 

B.   IMPROVEMENT  STRATEGY 
o  Knowledge  base  1s 

research  synthesis  on  four 

competencies  teachers 

should  have, 
o  Dev  products:  workshop 

model,  handbook  ft  video  ta 


C.   LINKAGE  STRATEGY 

1,  Collaborators/clients 

o  SEAs  sponsor  and  nominate 
participants 

o  SDO  personnel  are  trainees 

.  Services 

o  Develop  non-content  parts 

of  workshop  model 
o  Train  trainers 
,  Second  tier 
o  Ad  hoc 


D.  IMPACT 
o  20  1n  1  workshop  1n  '67 
o  32  by  2  of  above 


REMARKS 
Was  subject  of  3rd  party 
tracer  study. 
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KP/TT  Approaches  to  Staff  Development . 

AEL ,  RBS,  and  SEIL  all  designed  trainer  of  trainer  programs 
utilizing  materials  developed  for  that  purpose.  The  problem 
definitions  of  AEL  and  SEIL  combine  pragmatic  and  theoret  ic 
rationales.  SEIL  had  the  narrowest  focus,  namely  K-5  mathematics 
remediation.  AEL  and  RBS  included  both  curricular  foci  (math  and 
science,  oral  and  written  communication,  thinking  skills)  and  more 
general  staff  competencies  (research  on  staff  development, 
elementary  excellence,  and  instructional  supervision).  For  an 
improvement  strategy,  both  AEL  and  SEIL  produced  research  syntheses 
as  the  knowledge  base  for  their  training  materials.  It  is  not 
clear  whether  RBS  used  a  research  or  promising  practicrs  approach; 
it  .  specifies  "produce/refine  training  packages  in  three  content 
areas."  Both  AEL  and  RBS  refer  simply  to  "training  packages."  SEIL 
identifies  three  development  products:  a  workshop  model,  a 
handbook,   and  a  video  tape. 

The  labs  also  varied  in  their  linkage  strategies.  They  tended 
to  perceive  staff  development  as  an  internal  SDO  function  rather 
than  one  for  which  school  districts  look  for  outside  assistance. 
Although  state  NEA  affiliates  (AEL)  or  SEAs  (SEIL)  acted  as 
sponsors ,  the  c 1 ients  were  SDO  personnel  charged  with  staff 
development  responsibilities.  RBS  trained  both  SDO  and  SIO 
personnel . 

Curiously,  it  appears  that  none  made  specific  provisions  for 
the  training  that  clients  were  expected  to  provide.  Apparently 
they     believed     that  this     would     be     taken     care  of     by  selecting 
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individL^1  -  with  staff  development  responsibilities  (AEL)  or  from 
SIOs  with  improvement  roles  (RBS).  The  third  lab  (SEIL),  relying 
on  nominations  from  SEAs ,  found  that  some  of  its  trainees  were 
principals  with  no  training  responsibilities  or  teachers  who 
perceived  themselves  as  weak  in  the  subject  matter  and  therefore 
unqualified  to  train  others.  Perhaps  it  is  difficult  to  influence 
established  and  active  inservice  programs,  and  labs  may  not  have 
much  leverage  concerning  second  and  third  tier  training,  but  it 
seems  that  labs  need  to  give  further  thought  to  these  next  steps 
before  they  employ  a  TT  strategy.  Impact  data  indicate 
considerable  attrition  from  one  tier  to  the  next.  In  the  case  of 
AEL,  although  120  trainers  were  trained  in  six  workshops  in  1987, 
only  19  of  these  provided  training  to  others.  These  19  trained  236 
in  the  second  tier.  SEIL  held  only  one  workshop  for  20  trainers  in 
1987,  Only  two  of  these  trained  32  at  the  next  level.  Clearly 
reduction  in  the  attrition  rate  could  greatly  increase  the  leverage 
achieved  with  a  TT  approach. 

KP/ Information  Dissemination  Approaches  to  Staff  Development 

A  second  group  of  three  labs  (NCREL,  NE/I,  and  SEDL)  combined 
knowledge  production  witu.  information  dissemination  (see  Table  16). 
Probl-m  definitions  tended  to  be  pragmatic.  All  three  labs 
employed  a  promising  practices  improvement  strategy,  although  NCRFL 
included  a  component  for  designing  and  testing  training  materials, 
anc  NE/I   indicated  an  interest  in  using  adult  learning  theory. 

No  collaborate* s  wre  .identified  for  the  linkage  strategy. 
C,i<3nts  of  ths  inf  ,rmaticn     dissemination  efforts  were  more  general 
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™l!_26*    Ssl*ct#d  Approach*,  to  Staff  Davalopmant:   Knowledge  Production       and  Information  D1ssam1njt1c 


Das  1 0n  Faatura 


NCREL 


NE/I 


SEDL 


Program/ 
Projact 


A.  Problem 
Daf 1n1t1on 
(Educational 
Focus ) 


Program  for  Profaaslonal  Dav 

B.I  STAFF  DEVELOPMENT 


Priority  Araa  2:  Taachar 
Davalopmant 

2.1  PROFESSIONAL  DEV  MODELS 


Improvement 
Stratagy 


- .  Llnkaga 
Stratagy 

1.  Collabor- 
ators and 
c  Hants 

2.  Services 


3.  Provision 
for  2nd 
t1ar 

D.  Impact 
1st  laval 
2nd  laval 
3rd  laval 


E.  Rmmarks 


A.  PROBLEM  DEFINITION 
o  Raform  r a ports  call  for 
Improvad  1nsarv1ca  for 
both  baglnning  and 
axperlancad  taachara 
o  Naad  niw  goals  and  models 
&  1nnovat1va  dallvary  fc 
Implamantatlon  strategies 
o  Kaw  staff  dav  legislation 


t.  PROBLEM  DEFINITION 

o  Tha  varlaty  of  groups  that 

provlda  staff  davalopmant 

naad  support 


A. 3  PROVIDE  TA  [to  SIOs] 
TO  HELP  THEM  PREPARE  EL£M 
TEACHERS  &  ADMS  FOR  PARENT 
INVOLVEMENT 

A.  PROBLEM  DEFINITION 
Partnerships  with  parants  can: 

o  help  with  problam  of  shrinking 
resources  It  rising  expectations 

o  Improve  climates  for  learning 


B.   IMPROVEMENT  STRATEGY 
o  Study  and  catalog  staff 

dav  programs  It  practices 
o  Design  and  test  training 

materials 
o  Profile  practices  1n 

school*  of  education 
o  Prepare  papers 


B.   IMPROVEMENT  STRATEGY 
o  Apply  adult  learning 
theory 

o  Develop  effective  practices 
f 11e/d1rectory/gu1debook 


B.   IMPROVEMENT  STRATEGY 
o  Compile  bibliography  and 
directory  of  materials 
on  parent  Involvement 


C.  LINKAGE  STRATEGY 

1 .  Col laborators/cl 1onts 

o  Clients  -  "Dissemination 
partners'  (m1sc  KPOs  fc 
SIOs)  [Inferred] 

2.  Services 

o  Information  dissemination 
;1nf arred] 

3.  Second  tier: 
9  Ad  hoc 


LINKAGE  STRATEGY 
1.  Collaborators/clients 
o  Client*  -  LEAs,  ISAs 
and  IHEs 


2.  Services 
o  Information  dissemination 


3.  Second  tier: 
o  Ad  hoc 


D.  IMPACT 


D.  IMPACT 


E.  REMARKS 

Sources  "Addendum  to  Full 
Service  Plan  FY  1987"; 
Project  could  not  be 
Identified  1n  4th  Qtr  Report 


REMARKS 
Original  more  comprehensive 
program  scaled  down  1n  second 
ear  • 


C.  LINKAGE  STRATEGY 
1.  Collaborators/clients 
o  Clients  are  trainers  It- 
stats -level  tea  ad  assocs, 
SEAs,   IHEs ,  etc. 

f.  Services 

o  Develop  procedures  and 
recommendations  for 
providing  tech  assistance 

I.  Second  tier 

o  Ad  hoc 


P.  IMPACT 
o  Six  state-level  workshops 

for  165  representatives, 
o  No  data  on  second  and 

third  tiers 

.  REMARKS 
3ne  piece  of  programmatic 

effort  on  parent  Involvement. 
Described  as  TA  rather 

than  training. 
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than  targeted.  NCREL  apparently  sent  its  information  to  all  its 
"dissemination  partners,"  which  included  a  wide  variety  of  KPOs, 
SIOs  and  SDOs .     Similarly,   NE/I  sent   information  to  LEAs ,    ISAs,  and 


state-level  teacher  education  associations,  SEAs ,  and  IHEs.  The 
exact  nature  of  SEDL's  work  is  hard  to  categorize.  It  describes  it 
as  technical  assistance  (rather  than  training  or  information 
dissemination).  Six  state-level  workshops  were  held  for  165 
"representatives"  who  were  given  information  about  the  SEDL 
materials  on  parent  involvement  and  "procedures  and  recommendations 
for  providing  technical  assistance."  It  seems  closer  to  being  a 
trainer  of   trainers  program. 

No  data  on  impact  are  provided,     either   in  terms  of  adoption  or 
use     of     promising     practices     (NCREL  and     NE/I)     or     provision  of 
technical   assistance  by  those  receiving  the  SEDL  materials. 
Mlscel laneous  Approaches  to  Staff  Development 

Finally,  three  labs  had  unique  approaches  to  staff  development 
(FWL,  McREL,  and  NWREL) .  Profiles  of  these  programs  are  found  in 
Table  17. 

FWL .  The  approach  used  by  FWL  appears  to  be  almost  exclusively 
a  knowledge  production  effort.  The  Los  Angeles  School  District  is 
a  very  large  LEA  that  hires  over  3,000  new  teachers  each  year.  The 
FWL  is  focused  on  development  of  a  mentor  program  whereby 
experienced  teachers  provide  support  for  these  beginning  teachers . 
This  development  effort  was  a  collaborative  one  with  the 
Prof ess  ion a  1     Devel opment  Center     and  produced     three  resources ;  a 


IHEs. 


SEDL's     effort  was     more     targeted,     aimed  at     trainers  in 
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Table  17.     Selected  Approaches  to  Staff  Dtvipiint:  Miscellaneous 


Design 
Ptiturt 


Program/ 

Project 

Naai 


Problem 

Def  1n1t1or. 

(Educational 

Focus) 


Improvement 
Stratagy 


C.  Llnkaga 
Stratagy 

1.  Col labor* 
ators  and 
cllants 

2.  Sarvlcas 


3.  Provision 
for  2nd 
t1ar 

D.  Isjpact 
1st  laval 
2nd  laval 
3rd  laval 


irks 


FtfL 

(Knowledge  Production) 


Prof  Prop  k  Development 

EFFECTIVE  SUPPORT  FOR 
BEGINNING  TEACHERS 


A.  PROBLEM  DEFINITION 

1.  Naad:  Los  Angalas  hlrai 
ovar  3 ,000  now  teacheri 
par  yaar 

2.  Goal:  Assist  Los  Angola 
Prof  Dav  Cantar  train 
900  mentors 


8.   IMPROVEMENT  STRATEGY 
Jt  dav  w/  LEA  of  3  rasourca 
o  Loedor's  Gulda  for 

Preparing  Mantor  Taas 
o  Mantor  Taachar  Casabook 
o  Intarn  Taachar  Casabook 


C.  LINKAGE  STRATEGY 
1.  Collaborators/cllonts 
o  Professional  Development 
Center  of  Los  Angeles  LEA 


Services 

Development  ♦  publication 
and  sale  of  resource  books 
beyond  Los  Angeles 
Second  tier 

Trng  mentors  1s  regular 
responsibility  of  partner 


D.  IMPACT 
o  Not  specific      y  stated; 
Presumably  '    ->00  mentors 
trained  by    J  ctr  staff. 


E.  REMARKS 


McREL 

(Networking  *  Information  D1si 


Subtask  2.3:  Network  *  Broker 

People  end  Resources 
2.3.2:  Foster  Interpersonal 

Networks:  STAFF  DEV  NETWORK 


A. 
1 . 


2. 


PROBLEM  DEFINITION 

Lerge  region  with  googrephl 

diversity,  sparce  populetlo 

and  Isolated  professionals 

Limited  1nf restructure  end 

declining  local  and  state 

resources 


B.   IMPROVEMENT  STRATEGY 
o  Ad  hoc:  Identified  through 
network  Interaction 


C.  LINKAGE  STRATEGY 

1 .  Collaborators/clients 

o  Individuals  w  staff  dav  as 
major  rasp,  fr  SIOs,  SDOs. 
and  private  consultants 

2.  Services 

Network  creation  &  sponsorship 
o  Semi-annual  meetings 
o  Coordination  mechanisms 
o  Steering  committee 

J    Second  tier: 
o  Ad  hoc 


D.  IMPACT 

o  Increased  SEA  communication 
o  McREL  participates  1n  SEA 

1nserv1ce  programs 
o  SEA  exchange  of  personnel 

E.  REMARKS 


NWREL 
(Comprehensive) 


2.5  COL LEG I AL  TEACHER 
TRAINING 


A.  PROBLEM  DEFINITION 

1.  Too  few  excellence  reforms 
focus  on  Instruction  level 

2.  Goals: 

o  Establish  prof  dov  network 
o  Build  capacity  of  SIOs  to 

train  area  col laboratl ves 
o  Diss  findings  fr  kn  bases 

k  col lab  efforts  reg  k  net 

B.  IMPROVEMENT  STRATEGY 

o  Synthesize  res  on  effective 

schooling,  tea,  k  prof  dav 
o  Dav  handbooks  for  mentoring 

thru  col  lab  design  confs 
o  Find  promising  practices 

for  Induction  and  long-term 

prof  development 


C.   LINKAGE  STRATEGY 
1 .  Collaborators/clients 
o  Collaborators:  SEAs  e  IHEs 
o  Clients:  consortia  of  SDOs 


2.  Services 
o  Info:  diss  hbooks;  reg  conf 
o  TA  to  consortia 
o  Jt  trng  with  SIOs  at  demo 

sites  *  other  SIOs 
o  Demo  sites  1n  3  States 
o  Estab  prof  dav  network 

D.  IMPACT 
o  No  data 


E.  REMARKS 


it 

< 
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Leader's  Guide  for  Preparing  Mentor  Teachers,  a  Mentor  Teacher 
Casebook,  and  an  Intern  Teacher  Casebook.  The  linkage  strategy  was 
the  use     of  these  materials  by     the  Los  Angeles  School     District  in 


mentor  teachers  were  trained  by  the  Professional  Development 
Center.  In  addition,  the  materials  were  made  available  for 
purchase  by  other  districts.  In  this  case  joint  development  with  a 
large  SDO  virtually  assured  implementation. 

McREL .  McREL ' s  Staff  Devel opment  Network  Program  is  pr obabl y 
the  most  ooportunisti c  of  the  nine.  (Other  staff  development 
activities  are  carried  out  in  other  programs.)  It  consists  of 
creating  and  supporting  a  network  of  persons  responsible  for  staff 
development  in  SEAs ,  other  SIOs,  SDOs,  and  private  consultants. 
McRELfs  support  consisted  of  (1)  organizing  semi-annual  meetings, 
(2)  coordination  mechanisms,  (3)  a  steering  committee,  and  (4) 
distributing  related  information.  The  resulting  staff  development 
improvement  efforts  were  ad  hoc,  eme^ing  from  the  interaction  of 
network  members.  McREL  cites  as  impact  increased  communication 
among  staff  development  personnel  in  different  SEAs,  McREL 
participation  in  SEA  inservice  programs,  and  exchange  of  staff 
development   personnel   among  SEAs. 

NWREL.  The  staff  development  program  of  NWREL ,  Collegial 
Teacher  Training,  is  the  most  comprehensive.  It  notes  that  too  few 
excellence  reforms  focus  on  the  instructional  level .  The  goals  of 
the  program  are  to  r  cablish  a  professional  devel opment  network , 
build     the  capacity     of  SIOs     to  train     LEA  coll aborat i ves f     and  to 


its     regular     staff     development  program. 


Presumably     over  3,000 
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disseminate  regionally  and  nationaly  findings  from  knowledge  bases 
and  collaborative  efforts .  Three  improvement  strategies  are  used : 
research  synthesis,  handbook  development,  and  selection  of 
promising  practices  for  both  induction  and  long  term  professional 
development .  For  1 inkage ,  bo^h  SEAs  and  IHEs  are  1  is ted  as 
collaborators,  although  the  nature  of  the  collaboration  is  not 
specified.  Interestingly,  the  clients  are  not  individual  LEAs  but 
consortia  of  LEAs  interested  in  improving  staff  development 
efforts.  Given  the  small  size  of  most  Northwest  districts,  joint 
staff  development  efforts  are  apparently  felt  to  be  more 
cost-effective.  Specific  services  run  the  gamut,  including 
regional  conferences,  dissemination  of  handbooks,  establishment  of 
demonstration  sites  in  three  states,  joint  training  with  SIOs  at 
these  sites  and  at  other  SIOs,  provision  of  technical  assistance  to 
consortia  of  SOOs ,  and  establishment  of  a  professional  development 
network.  Unfortunately,  no  impact  data  are  provided. 
Comments 

Staff  development  was  recognized  as  an  area  cf  need  by  all 
laboratories.  Some  focused  on  the  problems  of  inducting  beginning 
teachers  while  others  focues  on  inservice  for  experienced  teachers, 
or  both.  One  or  more  labs  used  virtually  all  improvement  and 
linkage  strategies.  This  would  be  a  good  topical  area  for  labs  to 
get  together  and  compare  notes  on  what  works  best  and  possibly 
design  sor«?  comparative  studies  that  would  produce  more  systematic 
evidence. 
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The  Promising  Practices  Improvement  Strategy 
The  RFP  enjoined  labs  to  use  R&D-based  knowledge  as  the  basis 
for  its  improvement  efforts.  When  the  labs  employ  a  research 
synthesis  strategy  or  develop  materials  designed  with  reference  to 
some  research  knowledge  base,  it  is  clear  that  they  are  using  this 
approach.  When  they  search  for  and  select  promising  practices  for 
cataloging  and  disseminating,  it  is  difficult  to  say  whether  the 
practices  are  R&D-based. 

For  some  years,  programs  supported  by  OERI  have  attempted  to 
give  equal  weight  to  craft  knowledge  and  R&D-based  knowledge. 
During  this  same  period  philosophers  of  science  have  argued  the 
relative  merits  of  various  paradigms  such  as  positivism, 
behaviorism,  action  research,  interactive  research,  and 
nat  tralistic  inquiry.  "  These  issues  are  beyond  the  scope  of  this 
study,  but  we  would  like  to  get  a  clearer  picture  of  just  what  is 
Involved  when  labs  employ  a  promising  practices  methodology.  What 
kinds  of  search  strategies  are  employed,  and  what  criteria  of 
selection  are  used?  In  what  sense,  if  any,  are  the  practices 
R&D-based? 

Most  of  the  labs  employed  a  promising  practices  approach  in  at 
least  one  project.  Unfortunately,  the  information  available  for 
this  study  is  not  detailed  enough  to  permit  the  kind  of  analysis 
empl oyed     for  other     Issues .     For     example ,  act  ion     step  for  a 

project  might  specify  "Identify  criteria  for  selection  of  promising 
practices,"  but  the  criteria  used  are  not  reported  in  the  kinds  of 
documents  used     for  this     study.     Therefore,     this  section     will  be 
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limited     to  identifying     some     of  the     programs     and  projects  that 

empl oy     this  approach,     examining  some     var iat ions ,   and  discussing 

some  of  the  issues  involved. 

The     following  is     a   list     of     lab  programs     and  projects  that 

appear  to  employ  a  promising  practices  approach: 

FWL.   3.0     Enhancing      Teacher      Qua! ity      and     Support  for 
School -Baseo  Improvement : 

3.3.2:    Inventory  preservice  and  inservice  interests  and 

activities   in  the  western  region . 
3.5.1:     Help     districts     assess     exist  ing     school -1  eve 1 
pract ices  and  capabi 1  it ies . 

NCREL.   B.I.       Staff     Development :  Identify     distinctive  staff 

development     programs     in  two     states;     describe  data 

collection         procedures  and         standard^  employed. 
Publication  in  1988. 

NE/I.  3.1.  Resources  for  Effective  Classroom  Practice.  Six 
topical  areas;  publish  resource  bibl iographies ,  overview 
articles,  11st  of  materials,  and  list  of  program 
descriptions . 

NWREL.  Activity  2.4:  Item  and  Test  Information  Center:  Gather 
and  compile  tests,  testing  ideas,  assessment  approaches, 
issues  and   items ; 

Activity  2.5;  Collegia!  Teacher  Training:  Conduct  search 
for  promising  extant  models  for  induction  and  long-term 
professional   development . 

Activity  2.14;  Private  Sector  Networking :  Survey  regional 
and  national  linkage  models  and  classify  by  purpose. 
Activity  3 .4  Educational  Standards  and  Their  Impact  on 
Organizations :  Establish  a  repository  of  state  and 
district  standards  developed  throughout  the  Pacific  and 
Northwest  Regions,  as  well  as  selected  standard-setting 
"models"  identified  from  across  the  nation  (Task  3). 
Activity  4.7;  Study  of  the  Core  Curriculum:  Gather  data 
and  prepare  profiles  of  different  models  of  "core 
curriculum"   in  the  region. 

Activity  4.13;  School  Improvement  Research  Synthe^as : 
Identify,  describe  and  make  visible  and  available  for  use 
among  practitioners  information  about  exemplary  uses  of 
ef f ect  ive  school ing  pract  ices  for  school  improvements  at 
the  state,  intermediate  district  and  local  school  levels. 
Activity  4.14;  Promising  Programs  for  High  Risk  Youth : 
conduct  a  reg  ional  search  of  a  1 ter native  education 
programs  that  are  effective  at  the  middle  school  and  high 
school   1 evel . 
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Activity  4,18;  Study  of  Effective  Vocational  Education ; 
Identify  through  a  literature  review  and  contacts  with 
leading  R&D  institutions  applications  of  effective 
school ing  research  to  vocational   education . 

SEDL.  A.     Developing     Educational   Partnershi ps     with  Parents , 
Businesses .  and  Communities : 

A. 1 . 1 .        Identify     and       describe     promising  programs/ 

practices  of  school-business  partnerships. 
A . 2 . 1  .        Identify     and     descr i  be  examples     of     new  and 
promising  parent  in vol vement  programs  and  networks . 

B.  Applying  Technology  to  School     Improvement ;  Identify 
and  describe  innovative  and  promising  cl ass room  practices 
and  school   programs  that  use  tec hnol ogy . 

C.  Improving     Teacher  and     Administrator     Performance : 
Identify     and     synthesize       information     on     teacher  and 
admin istrator  performance  systems . 

SEIL.   Project  SEED     (Software  Evaluation     Exchange  Devel opment 
and     Dissemination ) :     Indexed       annotations     on  software 
evaluations     made  by     practitioners  trained     in  procedure 
and  mai 1 ed  to  schools . 


A     number  of     observations     can     be  made     about     this  array  of 

promising  practices  programs  and  projects: 

o  This     methodology     is     applied  not  only     to  classroom 

practices  but     also  administrative  practices,  testing, 

software,        [academic]       standards ,  and  professional 
devel opment  programs . 

o  Some  projects     look  for  practices   1  inked     to  pr inci  pies 
in     the  research     literature  (e.g.,     NWREL  4.13     and  4. 
18) 

o  One  part  of  the  FWL  project  seeks  to  enable  SDO 
personnel  to  make  better  choices  of  practices  rather 
than  to  provide  the  promising  practices. 

What  makes  a  practice  R&D-based?  It  can  acquire  this  status 
either  deductively  or  inductively.  In  the  linear  mode),  a  practice 
is  developed  on  the  basis  of  principles  uncovered  through  research. 
Much     development     has     b3en     inductive,     however.       Practices  are 
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designed  on  the  basis  of  professional  experience  or  hunch  and 
progressively  refined  through  evaluation  and  redesign.  Practices 
that  are  originally  designed  deductively  may  go  through  a  similar 
process  of  testing  and  refinement.  Whether  a  practice  deserves  to 
be  called  "R&D-based"  depends  on  the  degree  to  which  it  is 
logically  consistent  with  research  principles  and/or  subjected  to  a 
rigorous  process  of  evaluation  and  redesign. 

Research  itself  c^n  be  either  deductive  or  inductive.  The 
effective  schools  research  has  been  inductive  (for  the  most  part). 
Schools  judged  to  be  more  effective  on  given  criterion  measures 
were  found  to  exhibit  certain  characteristics  more  than  did  schools 
Judged  to  be  less  effective.  Sut  there  was  no  evidence  that  these 
characteristics  caused  the  schools  to  be  more  effective.  When 
schools  are  changed  to  exhibit  the  characteristics  of  effective 
schools,  this  may  constitute  a  deductive  test  of  principles  arrived 
at  inductively.  It  may  be  that  some  of  the  labs1  promising 
practices  projects  are  of  th.s  nature. 

An  important  evaluation  question  for  the  1 abs  is  whether  their 
promising  practices  activities  meet  the  test  of  logical  consistency 
with  research  principles  and/or  the  test  of  rigorous  evaluation. 
Practices  that  are  selected  solely  on  the  basis  of  practitioner 
testimonials  belong  in  a  different  category  of  "craft-based" 
practices . 


Conclusion 

This  chapter  has     analyzed  Tasks  2  and  4,     which  represent  from 
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60     to  78     percent  of     individual     labsT   effort.       Although  Task  2 

corresponds  to  the     linkage  strategy  and  Task  4     corresponds  to  the 

improvement  strategy,  we     again  found  that  all     projects  have  three 

strategic  dimensions :   a  1 inkage     strategy,   an   improvement  strategy , 

and  an  educational   focus.      Projects     tend  to  be  identified  in  terms 

of  the  strategic     dimension  that  was  the  point  of     departure  in  the 

planning  process. 

Further  refinements     were  made  in  the     conceptual   framework  for 

all  thr  ee  strategies.     Starting  with  a  set  of  programs  dealing  with 

improving  administrative  leadership,   the  educational   or  substantive 

focus  dimension  was  further  refined     by  observing  varieties  of  ways 

the  problem  was  defined.     Some  saw  the  problem  in  terms  of  the  need 

for  administrators  to  understand  new  bodies  of  research  findings, 
others     in  terms     of  the     isolation  of     administrators,   etc.  Labs 

used  both     theoretic  and  pragmatic     rationales  and  focused     on  both 

curricular  knowledge  and  teaching  competencies. 

Linkage     strategies  had     previously  been     analyzed   in     terms  of 

knowledge     base,     interorgan i zat ional     arrangements     (national  and 

regional     collaborators),     and     interpretations  of     the     "with  and 

through"     strategy.     Turning     to     a     set  of     Task     2  programs,  the 

linkage     strategy     was     elaborated     by  identifying     four     types  of 

interorgani zat ional     collectivities   (partnerships ,     col laborati ves , 

consortia,   and  networks)  and  differentiating  those  of  which  the  lab 

was  a     member  from  those     that  were  served     by  the  lab     as  clients. 

Some     tentative  findings     were:     the  collaborative  (multi-purpose, 

bi-lateral)     was     the     least     common     form     of  interorganizational 


ERIC 


4?a 


CHAPTER  V  TASKS  2  &  4  Page  V-45 

collectivity,  and  far  more  single-purpose  arrangements 
(partnerships  and  consortia)  than  mul ti- pur pose  (collaboratives  and 
networks )  existed . 

Improvement  strategies  previously  had  been  descri  bed  in  terms 
of  the  kn owl  edge  base  em pi oyed  (research,  products,  and  practi  ces  )  , 
information  services  provided,  and  the  KP  activities  involved 
(research,  evaluation,  policy  studies,  or  development).  In  this 
c hapter  a  set  of  Task  4  programs  was  further  studied  by  subdividing 
research  into  applied  research,  evaluation,  policy  studies  and 
planning;  and  coding  the  primary  source  of  data  (primary  data, 
secondary  analysis,  or  interaction  documentation).  Examples  of  all 
approaches  were  found.  Under  the  heading  of  "development/ 
demonstration  approach,"  four  categories  were  recognized:  lab 
development,  joint  development,  promising  practices,  and 
demonstration.  Programs  in  each  were  classified  by  types  of 
materials  (student,  teacher,  trainer,  and  administrator  materials). 
There  was  much  less  activity  involving  student  materials  than  the 
other   ki  nds . 

All  labs  had  programs  or  projects  dealing  with  staff 
development.  Three  labs  used  a  trainer  of  trainers  approach 
combined  with  the  production  of  training  packages.  Labs  tend  to 
see  staff  development  as  internal  LEA  function  and  identify  the 
final  trainers  in  the  chain  to  be  LEA  personnel ,  especial ly  in 
large  districts.  However,  they  often  work  with  SIO  personnel  in 
early  stages  of  the  chain.  Trainer  of  trainers  programs  were  found 
to  be  weak  in  making  specific  provisions  for  first  wave  trainers  to 
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follow  through  and  train  others. 

Three     other       labs     combined     knowledge     production       with  an 
information     dissemination  strategy     in     seeking     to  improve  staff 
development.       Evidence     for  the     impact     of     these  approaches  was 
,  arse . 

The  other  three  labs  had  different  approaches  to  staff 
development.  FWL  was  largely  a  joint  development  effort  with  the 
Los  Angeles  public  schools.  McREL  combined  networking  with 
information  dissemination,  while  NWREL  used  a  comprehensive 
strategy . 

It  was  suggested  that  staff  development  was  an  area  in  which 
useful  comparative  studies  or  "strategic  research"  might  be 
conducted . 

Finally,  the  "promising  practices"  approach  to  improvement, 
which  involves  collecting  information  about  extant  programs,  was 
singled  out  for  special  analysis.  It  was  noted  that  it  may  or  may 
not  be  an  R&D-based  strategy,  depending  on  whether  the  practice  is 
logically  consistent  wiVh  research  findings  and/or  subjected  to  a 
rigorous  process  of  evaluation  and  redesign.  The  promising 
practices  methodology  was  applied  not  only  to  classroom  practices 
but  also  to  administrative  practices,  testing,  software,  standards, 
and  prof ess  ion a 1   devel opmen t  programs  . 
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CHAPTER  VI 


SUMMARY  AND  CONCULUSIONS 


Nature  of  the  Study 
This     study       has     described     the     nine       regional  educational 
laboratories     supported   by     the     U.     S.     Department  of  Education's 


operating  under  five-year  contracts  for  1986-1990.  The  study  has 
analyzed  lab-produced  documents  describing  lab  operation  for  the 
first  two  years  of  this  period,  highlighting  the  status  of  the 
program  at  the  end  of  the  second  contract  year.  These  were  largely 
management  documents  (plans,  annual  reports,  sel f -assessment 
reports,  etc.)  rather  than  program  documents. 

These  aspects  of  the  study,  dictated  by  *the  request  for 
proposal,  impose  certain  limitations  on  the  analysis.  The  reports 
vary  greatly  in  detail  and  specificity.  Consequently  it  is 
possible  in  some  instances  that  a  lab  may  be  coded  as  not 
exhibiting  a  certain  characteristic  or  undertaking  a  given  kind  of 
activity  when  that  is  not  the  case.  Such  information  may  exist  in 
some  document  not  examined ,  or  if  the  information  was  provided  it 
could  have  been  missed  in  the  analysis.  This  possibility  was 
considerably  increased  because  several  lab  reports  lack  continuity. 
For  example,  a  hierarchical  program  structure  with  every  program 
project  assigned  letters  and/or  numbers  would  be  set  out  in  a  plan 
but  would  be  abandoned  or  changed  in  later  documents.  Having  this 
report  reviewed  by  both  the  OERI  institutional  liaisons  and  the 
labs  should  help  overcome  such  problems. 


Office     of     Educational   Research     and     Improvement . 


The  labs 


are 
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Some  readers  may  doubt  the  credibility  of  lab  produced 
documents.  If  one  discounts  occasional  passages  of  self- 
congratul at  ion ,  the  factual  information  can  be  accepted  as 
reasonably  valid.  There  are  many  examples  of  candor  in  discussing 
problems  and  how  they  were  dealt  with.  If  OERI  did  not  believe 
these  reports  contained  useful  information  it  would  surely  not  have 
commissioned  this  study. 


Conceptual  Frameworks  f 
One  way  that  this  report  has  attempted  to  advance  our 
understanding  of  lab  operations  is  by  borrowing,  adapting,  or 
inventing  conceptual  frameworks  for  profiling  and  comparing  lab 
programs  and  projects.  Hopefully  they  will  prove  useful  in 
designing  further  studies  of   lab  strategies. 

The  RFP  governing  the  lab  competition  has,  of  course,  been  a 
major  point  of  reference  (NIE  1984).  In  that  document  the  mission 
of  regional  educational  laboratories  was  specified  by  the  task 
structure  and  a  set  of  "statements"  (see  Appendix  A).  All  lab 
programmatic  efforts  were  found  to  have  three  strategic  dimensions 
that  can  be  derived  from  the  RFP:  an  educational  focus,  an 
improvement  strategy,  and  a  linkage  strategy.  The  major  difference 
is  that,  whereas  the  RFP  specifies  a  linkage  strategy  in  Task  2  and 
an  improvement  strategy  in  Task  4,  this  analysis  has  demonstrated 
that  programs  and  projects  listed  under  these  tasks  exhibit  all 
three  strategies.  This  three-dimensional  schema  has  provided  the 
major     framework      for     the      analysis     of     all       lab  programmatic 
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activities.  Each  dimension  has,  in  turn,  been  further  broken  down 
into  more  detailed  classifications  of     tactics,   as  follows: 

(1)  Every  (non-management)  program  and  project  has  a 
substantive  fucus.  What  aspect  of  education  is  being  addressed? 
The  terminology  used  for  this  strategic  dimension  varies  in 
different  chapters,  but  t  )e  most  generic  and>  appropriate  name  is 
probably  educational  focus.  In  the  context  of  needs  assessment 
this  dimension  was  examined  as  educational  need  or  problem.  In  the 
context  of  state  policy  analysis  it  was  examined  as  policy  issues 
and  domains.  An  adaptation  of  a  classification  of  policy  issues  or 
domains  used  by  FWL  and  derived  from  one  by  Mitchell  and 
Encarnation  (1983)  was  found  to  be  reasonably  comprehensive  and 
mutually  exclusive.  In  the  context  of  Tasks  2  and  4  educational 
focus  is  examined  in  terms  of  variations  in  problem  definition, 
including  a  distinction  between  theoretic  and  pragmatic  rationales. 
Clearly,  the  specifics  of  how  a  problem  is  defined  will  have  a  lot 
to  do  with  the  selection  of  other  strategies  and  tactics. 

A  recapitulation  of  the  categories  used  to  describe  the 
educational  focus  follows.  These  and  other  classifications  in  this 
chapter  update  and  consol  ida'ce  conceptual  frameworks  used  in  the 
analysis.  No  one  analysis  in  the  body  of  the  report  used  the  f ul  1 
set  of  categories . 

EDUCATIONAL  FOCUS 

Problem  definition 

Theoretic  rationale 
Pragmatic  rati onale 
Educat 1  onal   need/pro bl em/ pol i cy/ i ssue  domain 
Buildings  and  facilities 
Curriculum  and  Instruction 
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Organ izat  ion  and  governance 

Program  definition 

School  finance 

School  personnel 

Student  type 

Student  test  ing 


(2)  Al 1  programmatic  activities  have  an  improvement  strategy . 
Labs  are  limited  to  knowledge-based  improvement  strategies  by  the 
RFP  (in  contrast  to  strategies  based  on  providing  funds,  changing 
regulations,  etc).  This  dimension  xDcuses  on  the  types  of 
knowledge  used  for  educational  improvement  and  how  it  is  obtained 
and  processed.  Some  facets  of  knowl edge-based  improvement 
strategies  examined  include  knowledge  bases  used,  information 
services  provided,  and  types  of  KPU,  including  sub-types  of 
research  approach  and  primary  sources  of  data. 

A  recapitulation  of  the  categories  used  to  describe  the 
improvement  strategy  follows: 

IMPROVEMENT  STRATEGY 
Knowl edge  base 

Research  findings,    by  field  (ad  hoc) 
Effective  schools 
etc  . 
Products 
Extant 

To  be  developed 
Pract i  ces 
Extant 

To  be  compiled 
Informati on  services 
Database  development 
Reports  based  on  databases 
Knowledge  production  to  be  undertaken 
Approach 

Research 

Evaluation 

Pol  icy  studies 

Planning 

Development 


464 


CHAPTER  VI  CONCLUSION 


Primary  type  of  data 
Primary  data 
Secondary  ana  1 ys  is 
Interact i on  document at i on 

(3)  All  programmatic  activities  have  a  1 inkage  strategy .  Labs 
are  sociologically  marginal  organizations  operating  in  a  loosely 
coupled  configuration  of  educational  units.  Since  education  lacks 
system  characteristics,  there  is  no  assurance  that  new  knowledge 
and  oractices  will  flow  through  it  efficiently.  Labs  are  in  the 
position  of  having  to  continually  negotiate  their  role  in  the 
organizational  infrastructure .  Consequently  al 1  programs  and 
projects  must  specify  a  strategy  and  tactics  for  linking  to  other 
educational  organizations.  The  RFP  called  for  an  indirect  "with 
and  through"  strategy  as  the  dominant  mode  of  operation,  i.e.,  labs 
would  work  primarily  with  and  through  other  service  improvement 
organizations  (SIOs)  rather  than  directly  with  service  delivery 
organizations  (SDOs).  In  this  context,  the  conceptual  framework 
was  further  elaborated  to  specify  knowledge  bases, 
interorganizat ional   arrangements,   and  communication  nrdes. 

A  recapitulation  of  the  categories  used  to  describe  the  linkage 
strategy  foil ows : 


LINKAGE  STRATEGY 

Knowledge  base 

Research  findings,   by  field   (ad  hoc) 
GDPA  study  (Louis  et  al  1984) 
DESSI   study  (Crandall   and  Loucks  1983) 
etc . 

Ordinary  know 1  edge 
Products 
Extant 

To  be  developed 
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Practices 
Extant 

To  be  devel oped 
Interorganizat ional  arrangements 
Col iaborators 

Nat  i  onal   col  1  a bora tors 
Other  labs 
Un i versi ty  centers 
National  associations 
Other 

Reg  i  ona 1   col  1  a bora tors 
KPOs 
SIOs 
SDOs 
CI ients 

Pr i  mary 
Chiefs 
Other  SEA 
State  government 
St ate- 1  eve 1   associat  i  ons 
IHEs 
ISAs 
SDOs 

Cross  section 

Other 
Range 

Narrow 

Medium 

Broad 
Type  of  client 

Organizations 

Individuals 

Networks 

Mi  xed 

Interpretation  of  "with  and  through"  strategy 
SIOs  are  clients 

SIOs  are  col  1 aborat ors/sponsorc ,   SDOs  are  clients 
SDOs  are  col laborators  and/or  cl ients 
Type  of   interorganizat ion  collectivity  (IC) 
Lab   is  member  of  IC 

Partnershi  p 

Consortium 

Col  labor ati ve 

Networ  k 
IC  is  client  of  lab 

Partnershi  p 

Consort i  urn 

Col  1 aborat  i ve 

Network 
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Commun  icat i on  mode 
Approach 
Regional 
State-by-state 
Type 

Inf or mat i on  services 

Search  and  ret r ieva 1 

Publ icat ions 

El ect ron ic  services 

Presentat  ion  meet  i  ngs 

Briefings 
Technical  assistance 

Telephone,   mai 1 

Tn- person  consultations 
Professional   devel opment 

Training  wo r ks hops 

Training  of  trainers 
Other 

Participation  in  inservice  programs 

The  conceptual  frameworks  presented  above  deal  with  lab  program 
activities.  Other  frameworks  apply  to  organization,  governance, 
and  planning  activities,  but  only  those  for  planning  activities 
will   be  reviewed  here.'* 

The  pi anning  process  impl icit  in  the  RFP  requirements  and 
exhibited  by  the  labs  was  a  version  of  strategic  planning .  Its 
major  components  are  needs  assessment,  regional  capacity 
assessment,   self-assessment,   and  laboratory  plans. 

Needs  assessment  might  be  structured  ir,  terms  of  the 
classification  of  policy  domains  presented  in  the  educational  focus 
framework.  Needs  assessment  has  tended  to  be  pragmatic  in  orien- 
tation. Consideration  might  given  to  structuring  needs  assessment 
along  theoretical  dimensions.  For  example,  how  are  regional 
schools  distributed  in  terms  of  characteristics  of  effective 
schools?  Of  course  labs  are  dependent  on  the  availability  of  good 
indicator     data  for     this  kind     of   information.       Several   labs  did 
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collect  needs  survey  data  using  the  Grunig  communication  theory, 
which  seemed  to  oe  useful  in  determing  the  degree  of  concern  with 
speci  f  ic  issues .  A  number  of  mean  i  ngs  of  " need "  were  noted , 
and  the  concept  should  be  clarified  for  further  needs  assessment 
efforts.  Further,  needs  can  be  specified  at  different  levels  of 
generality.  A  level  midway  between  the  generic  functions  of 
education  ard  the  level   of  technical   design  was  recommended. 

The  weakness  of  regional  capacity  assessment  was  noted, 
together  with  the  failure  to  use  the  methodology  developed  in  the 
ARROE  Study  (Frankel  et  al  1979;  Lehming  1982).  That  study 
collected  information  on  educational  organizations  performing 
research  und  research-related  activities  by  type  and  including 
purpose,  areas  of  primary  educational  R&D  work,  size  of  staff, 
specialities  of  professional  staff,  amount  and  source  of  funds  with 
breakdowns  by  educational  level  and  R&D  function,  and  types  of 
publications  and  dissemination  activities.  Adaptations  of  this 
framework  to  make  it  commensurate  with  other  components  of  the 
strategic   planning  model   would  be  necessary. 

A  review  of  the  questions  addressed  in  self-assessment 
activities  revealed  two  types:  criterion  and  purpose  questions. 
Criterion  questions  could  be  grouped  under  the  three  strategic 
d I  mens ions  discussed  above  in  addition  to  a  fourth  for  organization 
and  management. 

CRITERION  EVALUATION  QUESTIONS 
Educational  focus 
Rel evance 
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Improvement  Strategy 

Qual i ty 

Uti 1 ity 

Impact/effect 

CI  lent  satisfaction 
Li  nkage  st  rat eg y 

Interorganizati  onal   ar  rangemcnts 

Reaching  audi  en ce 

Lab  vislbi 1 1ty 

Indi  rect  strategy 
Organ i  zati  on  and  management 

Efficiency 

Capacity  for  sel f -assessment 


PURPOSE  EVALUATION  QUESTIONS 
Improve  program 

Improve  organization/management 
Improve  sel f -assessment 
Development  staff 
Achieve  contract  compliance 
Inc  rease  know 1  edge 

At  a     more  general   level,     a  variety     of  models  or     images  were 
employed  in  sel f -eva 1 uat 1 ons . 

EVALUATION  MODEL  OR  IMAGE 

Systems/CI PP 
Quality  control 
Strategic  pi annlng 
Goal   free  evaluation 
Eva 1 uat or  as  educator 
Inst 1tuti onal  renewal 


Lab  plans  are  expected  to  f 1 ow  from  these  needs-sensing , 
capacity  assessment ,  and  sel f -assessment  activities .  One  would 
therefore  expect  the  plans  to  use  the  conceptual  frameworks  related 
to  each  of  these  processes.  In  addition,  there  is  the  issue  of  how 
lab  activities  are  structured  into  work  units  and  organized  for 
supervision  and  management . 

The  present  study  found  the  task  structure  mandated  by  the  RFP 
useful  1n  providing  more  detail  on  the  mission  of  the  labs  but 
tended     to     be     confusing     for     structuring     work.       Some     kind  of 


ERLC 


CHAPTER  VI  CONCLUSION  PAGE  VT. -10 

hierarchical  structuring  of  programs,  projects,  and  activities  was 
used  by  virtually  every  lab  and  seems  desirable.  Problems  arose 
when  names  c«nd  numbers  of  wor  k  un  i  ts  were  changed  and  it  became 
difficult  to  trace  a  work  unit  from  one  report  to  another  (e.g., 
from  the  full  service  Dlan  to  annual  reports,  to  sel f -assessment 
reports ,   etc . ) . 


Findings 

Governance  and  Organization 

The  nine  regions  differed  widely  in  their  demographic, 
educational  and  economic  characteristics.  However,  there  is 
probably  as  much  variation  within  regions  as  between  them,  and 
regional  homogeneity  is  not  the  basis  for  the  regional  organization 
of  laboratories;  Rather,  logistic  considerations  such  as  size  of 
area,  travel  distances,  and  number  of  organizations  with  which  to 
establish  relations  dictate  a  sub-national  approach  to  laboratory 
services .  Whether  nine  is  the  right  number  or  the  present 
configuration  of  states  into  regions  is  the  right  ons  is  an  open 
question.  Nevertheless,  given  the  difficulty  of  a  laboratory 
establishing  itself  or  changing  constituencies,  changes  should  be 
considered  only  in  response  to  some  compelling  demand.  It  is 
difficult  to  discern  the  rationale  for  the  relationship  between 
budget  levels  and  regional  requirements.  It  may  be  desirable  to 
find  a  new  formula  for  the  next   round  of  competitions. 

Labs       have     met       federal       specifications     for  establishing 
independent  governing     boards  and     seem  well   connected     to  regional 
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constituencies  both  through  their  boards  and  adjunct  structures 
such  as  advisory  committees.  This  is  especially  important  given 
the  loosely  coupled  nature  of   the  educational  configuration. 

In  terms  of  organization,  all  labs  have  some  combination  of 
program  and  service  units.  .  Most  employ  some  form  of  matrix 
management.  If  they  did  not  have  to  report  to  OERI  by  task,  both 
organizational  structures  and  reporting  requirements  might  be 
simplified.  While  a  small  degree  of  decentralization,  as  practiced 
by  FWL  and  McREL,  for  example,  seem*  to  work  reasonably  well,  the 
mone  radical  form  tried  initially  by  NE/I  had  to  be  abandoned. 
Labs  would  probably  have  to  be  larger  by  several  orders  of 
magnitude  before  radical  decentralization  was  feasible  (i.e.  large 
enough  to  have  a  "critical  mass"  at  every  location). 
Planning 

Some  of  the  planning  findings  have  been  covered  above  in  the 
section  of  planning  conceptual  frameworks.  But  a  few  additional 
comments  are  in  order. 

Labs  do  a  reasonably  good  job  of  needs  assessment  but  a  poor 
job  of  regional  capacity  assessment.  Given  the  requirement  that 
labs  stress  the  "with  and  through"  strategy  it  might  be  helpful  if 
laDs  viewed  regional  capacity  assessment  as  measuring  the  needs  of 
regional  service  improvement  organizations.  Labs  also  need  to  make 
explicit  the  ways  in  which  components  of  the  strategic  planning 
model  are  analyzed  in  relations  to  each  other.  What  is  the  logic 
and  analysis  whereby  needs  are  compared  with  capacity  to  yield 
planning       priorities?        Alternatively,       if       regional  capacity 
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assessment  is  not  necessary  to  good  planning  it  should  be  dropped 
from  the  model . 

Sel f -assessment  as  presently  conducted  is  trying  to  serve  too 
many  purposes,  and  the  process  needs  to  be  separated  from  OERI's 
program  evaluation  efforts.  In  addition,  product  testing  in  the 
devel opmont  process  or  selection  of  promising  practices  should  be 
outside  the  bounds  of  sel f -assessment .  Many  documentation 
activities  (e.g.,  phone  logs)  may  be  useful  for  internal  management 
but  are  not  particularly  useful  for  reporting  to  OERI .  Most 
contract  compliance  issues  should  be  relegated  to  quarterly  and 
annual   reports  and  limited  to  a  management  by  exception  procedure. 

Most  important,  new  emphasis  needs  to  be  placed  on  an  RFP 
requirement  that  scrims  to  have  been  largely  overlooked.  "...the 
laboratory  is  expected  to  contribute  to  knowledge  about  effective 
strategies  for  improving  education  through  careful ly  designed 
studies  of  how  its  own  dissemination  and  improvement  efforts  are 
working"  (NIE  1984,  p  21).  The  AEL  examination  of  the  study  group 
strategy  and  tracer  studies  supported  by  AEL  and  SEIL  appear  to  be 
examples  of  what   is  needed. 

This  goal  is  give  explicit  recognition  in  the  Task  5  Evaluation 
Col  la  bora  t  ion .  The  Summary  Report  of  the  Task  !5  Evaluation 
Col laboration   (1937)   lists  as  one  of  four  objectives: 

To  provide  a  broadened  perspective  on  laboratory 
operations  by  synthesizing  evaluation  information  on 
the  effectiveness  of  selected  major  laboratory 
strategies 
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However,  the  initial  activity  identified  to  implement  this 
objective  seemed  rather  limited.  It  was  to  compile  a  descriptive 
synthesis  of  how  Tasks  2  and  3  were  being  implemen-ed  at  each 
laboratory.  Only  four  labs  had  provided  the  necessary  information 
by  the  end  of   1 987 , 

Work  with  State  Level  Decisionmakers 

At  least     one  lab  viewed     the  task  of  working     with  state-level 

decisionmakers  on  school  improvement  issues  risky  because 
maintaining  a     neutral   posture     on  controversial   policy     issues  was 

difficult,   but  -lost   labs  did     not  even  mention  such  difficulty.  In 

most     regions  other     organizations  seem     to  welcome     the  idea     of  a 

lab's  convening     diverse  groups     to  discuss     and  analyze     issues  of 

common  interest  and  otherwise  pi  ay  a  catal ytic  role. 

Labs     differed  *;n     whether     they  focused     their     Task  3  effort 

largely     on  the     CSSOs  or     SEAs  more     generally,   or     worked  with  a 

broader  cross  section  including  the  governors'   offices,  legislative 

committees,     professional   associations     and  interest     groups.  They 

also  differed     considerably  in  the  improvement     role  assumed .  Some 

functioned     primarily     as  convener     of     state     and  regional     pol icy 

forums  and  conferences,   some  as  resources  for  policy  analysis,  some 

as  monicor  of  educational   reform  efforts,     etc.     This  is  an  area  in 

which  some  progress  was  made  in     Task  5   in  planning  some  activities 

for     year  three     and  beyond     as  coll aborati ve     lab  efforts .       Thei  r 

support     of     Wi 11 iam     Dunn     at     the     Uni versi  ty     of     Pittsburgh  in 

elaborating     his     ADD  model     and     preparing     a  handbook     of  policy 

analysis  methods     should  help     considerably  in  developing     a  common 
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understanding  of  the  policy  analysis  runction. 

Most  1  a  bs  d  i  rected  thei  r  efforts  pr  imar  i 1 y  at  the  ear  1 y  stages 
cf  the  policy  process  (agenda  and  formulation).  RBS  was  a  notable 
exception ,  focusing  primar i ly  on  the  impl ementat ion  and  evaluation 
stages . 

One     un  resol  ved   issue     needs  to     be  addressed .        1 1  wou*l  d  seem 

essential     for  each     lab     to  have     information     on  the  educational 

reform     legislation  and     programs   in     each  state     and  to     know  just 

which  states  are     engaged  in  different  kinds     of   initiatives.  This 

is  logical  aspect  of  environment  scanning  or  needs  assessment.  In 
addition,     this     information     would     be     useful     to     many  national 

organizations,  and  organizations  participating  in  the  State 
Education  Policy  Consortium  expressed  such  a  need.  Some  labs 
collect  these  kinds  of  data,  but  whether  regional  laboratories  are 
the  best  mechanism  for  developing  this  kind  of  national  database  is 
an  open  question.  Data  comparable  on  a  national  basis  are  needed, 
and  it  might  be  more  practical  for  OERI  or  the  Center  for  Education 
Statistics  to  collect  the  data  in  some  other  way. 
Tasks  2  and  £ 

Although  Task  2  corresponds  to  the  linkage  strategy  and  Task  4 
corresponds  to  the . improvement  strategy,  all  programs  and  projects 
classified  into  and  reported  to  OERI  under  these  rubrics  were  found 
to  have  all  three  strategic  dimensions  (educational  focus,  linkage 
strategy,  and  improvement  strategy).  In  analyzing  this  set  of 
activities  it  was  possi  ble  r0  elaborate  various  parts  of  the 
conceptual   framework ,   as  reported  above . 

4m 


9 

ERIC 


CHAPTER  VI  CONCLUSION 


PAGE  VI-15 


In     examining     a     set     of  programs     to     improve  administrative 

practices,   variations  in  defining  the  problem  were  observed: 

o  Local  administrators  have  a  great  responsibility  for 
implementing  changes  resul ting  from  the  reform 
movement . 

o  There  are  important  bodies  of  research  on  school 
improvement ,  instructional  leadership,  etc.,  that 
administrators  need  ^o  become  familiar  with. 

o  Schools  and  their  leaders  need  to  develop  a  culture 
of  inquiry  orienting  them  toward  using  knowledge- 
based  resources   in  their  attempts   to  improve  schools. 

o  School  administrators  are  physical ly  isolated,  and 
new  structures  are  needed  to  put  them  in  touch  with 
their  peers  and  help  them  access  knowledge-based 
resources  for  school   improvement . 

olt  is  a  mistake  to  focus  exclusively  on  the 
principal's  role;  leadership  is  provided  by  a  number 
of  rol es  at  school   and  central   of f ice  1 evel s . 

Two  main  approaches  to  improvement  were  found.  One  synthesizes 
relevant  research  findings  and  develops  them  into  training 
packages.  The  other  "collects,  reviews,  and  packages  promising 
administrative  practices.  The  most  common  vehicle  for  linkage  was 
the  pr inci pal shi p  academy.  These  academies  are  sponsored  by 
different  kinds  of  service  improvement  organizations,  and  labs 
generally  worked   "with  and  through"   these  organizations. 

The  further  study  of  linkage  strategies  was  placed  in  the 
context  of  interorganizational  theory  (Negandhi  1975),  and  four 
types  of  interoganizational  collectivities  f I C )  were  formulated, 
based  on  whether  the  collectivity  was  bilateral  or  multilateral  and 
whether  it  had  a  single  purpose  of  mul tiple  purposes .  These  were 
further  differentiated  in  terms  of  whether  the  lab  was*  a  member  of 
the     IC  or     provided  services     to  a     client   IC.       While  it     was  not 
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possible  to  make  a  comprehensive  classification  of  Task  2  and  Task 
4  programs,  the  analysis  produced  several  suggestive  findings 
worthy  of  further  study.  The  N  collaborative  (multi-purpose, 
bilateral)  was  the  least  common  form  of  tq.  More  single-purpose 
arrangements  ( partner's  hi  ps  and  consortia)  than  mul  ti -purpose 
(coll  a bora t i ves  and  networks )  were  *ound . 

A  more  detailed  examination  of  research  approaches  found 
examples  of  applied  research,  evaluation,  policy  studies,  and 
development.  In  each  of  these,  examples  were  found  using  each 
source  of  data  (primary  data,  secondary  analysis,  and  interaction 
documentation) . 

A  group  of  programs  on  staff  development  was  examined  to  refine 
our  understanding  of  the  improvement  tactics  used.  Three  labs 
combined  a  training  of  trainers  approach  with  development  of 
related  training  packages.  These  programs  tended  to  be  deficient 
in  terms  of  making  adequate  arrangements  for  those  trained  to 
provide  second  tier  training. 

Thr  ee  other  labs  combined  knowledge  production  activities  such 
as  publications  and  information  packages  with  information 
dissemination  activities.  Little  evidence  of  impact  from  these 
strategies  was  presented. 

Another  three  1 abs  had     unique  approaches  to  staff  development 
FWL     worked  with     the  Professional     Development  Center     of  the  Los 
Angeles  Public  Schools  to  develop     three  sets  of   training  materials 
for  mentor     teachers.     McREL  combined  network     creation  and  support 
with     information       dissemination.       NWREL     used       a  comprehensive 
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strategy,  using  just  about  every  improvement  and  linkage  tactic. 

Finally,     a     separate     analysis     was     made     of     the  "promising 


practices"  approach  to  improvement.  This  tactic  consists  of 
collecting  descriptions  of  programs  and  practices  already  in 
existence  and  providing  access  to  this  information  to  others.  This 
methodology  was  applied  not  only  to  classroom  practices  but  also  to 
administrative  practices,  testing,  software,  academic  standards, 
and  professional  development  programs.  Unfortunately,  the 
documentation  available  for  this  analysis  did  not  provide  much 
information  on  methods  of  identifying  promising  practices,  the 
criteria  used  for  selecting  them,  or  evidence  of  effectiveness.  It 
was  noted  that  this  approach  may  or  may  not  be  an  R&D-based 
approach  to  improvement,  depending  on  whether  the  practice  is 
logically  consistent  with  research  findings  or  subjected  to  a 
rigorous  process  of  evaluation  and  redesign. 


At  a  number  of  points  the  tension  between  the  rational  systems 
perspective  and  the  conf igurational  perspective  was  noted.  A 
similar  tension  exists  between  requirements  for  proactive  planning 
and  need  for  accountability  under  government  contracts  on  the  one 
hand  and  need  to  be  flexible  and  responsive  to  shifting  demands 
from  constituents  on  the  other.  These  tensions  cannot  be 
eliminated,  but  they  can  be  ameliorated  if  all  actors  in  the  drama 
get  a  better  understanding  of  the  limits  of  planning  and 
accountability.     Lab     programs  are  high-risk  endeavors     that  can  be 
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undercut  by  unpredictable  changes  in  their  environment  such  as 
changes  in  SEA  personnel.  The  important  thing  is  to  have  consensus 
on  the  broad  mission  and  goals  of  the  labs  and  recognition  that 
changes  in  specific  activities  in  response  to  unforeseen 
circumstances  are  all  right  if  they  are  consistent  with  broader 
purposes.  The  RFP  under  which  these  laboratories  were  selected  and 
funded  did  an  excellent  job  of  clarifying  the  mission  of  the 
program  and  provides  a  good  basis  for  program  management.  It  does 
not  appear  at  this  point  that  any  radical  changes  would  be  needed 
for  the  next  round  of  competitions. 

Several  minor  adjustments  have  been  suggested  along  the  way. 
One  is  to  devise  a  new  task  structure  that  does  not  define  any  one 
of  our  three  strategic  dimensions  as  a  separate  task.  On  the  other 
hand,  it  might  be  useful  to  ask  that  the  three-dimwnsional  schema 
be  used  in  describing  each  programmatic  effort.  No  program 
description  would  be  complete  unless  it  described  its  educational 
focus,   improvement  strategy,   and  linkage  strategy. 

Another  suggestion  was  to  develop  more  specific  guidelines  for 
annual  reports,  quarterly  reports,  sel f -assessment  reports  and 
needs  sensing  reports.  There  is  some  overlap  among  these  reports, 
and  the  separate  purpose  of  each  needs  sorting  cut.  It  would  also 
be  desirable  to  define  a  program  structure  of  programs,  projects, 
and  activities  that  would  be  consistently  followed  from  one  report 
to  another  and  over  time  and  that  would  permit  development  of  a 
management  information  system  for  the  total   laboratory  program. 

The       regional       educational       laboratory     program       has  been 
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controversial  for  over  20  years.  It  never  lacks  for  critics  who 
ask  for  hard  evidence  of  massive  impacts.  Alas,  few,  if  any, 
government  programs  can  meet  that  ^est .  Perhaps  an  analogy  exists 
between  the  1  a bora tor y  program  speci f ical 1 y  and  the  educat ion a  1 
system  generally  and  the  bumble  bee.  We  are  told  that  according  to 
all  the  princi  pi es  of  aerodynamics  the  bumbl e  bee  cannot  fly  -  but 
it  does.  Sometimes  it  seems  as  if  we  are  told  that  the  educational 
system  is  a  total  f ai lure :  that  chi ldren  don  f  t  learn ,  teachers 
don't  teach,  and  new  knowledge  has  no  impact  on  the  improvement  of 
education.  Yet  our  common  sense  tells  us  "it  ain't  necessarily  so" 
-  that  somehow  it  works  in  most  places  and  at  most  times.  Our  task 
is  to  find  cut  more  about  how  and  why  it  works  when  it  does  so  we 
can  improve  education  in  all  places  for  all  children.  The 
laboratories  are  making  steady  progress  toward  doing  just  that. 
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APPENDIX  A 

EXCERPTS  FROM  REQUEST  FOR  PROPOSAL 
REGIONAL  EDUCATIONAL  LABORATORY  INSTITUTIONAL  OPERATIONS 

Task  Structure 

Task        Develop  effective  governance,  management,   planning  and 
evaluation  systems  for  the  laboratory. 

Subtask  1.1:   Design  and  1mpl ement  effective  governance , 

staffing,  and  management  systems  for  the  laboratory. 

a.  Establish  or  reshape  the  governing  board  and  other 
advisory  structures. 

b.  Develop  or  Improve  management  systems  and  procedures  for 
the  laboratory . 

c.  Recruit  and  assign  staff  and  develop  or  refine  policies  a 
procedures  for  their  effective  utilization. 

Subtask  1.2:  Assess  regional  needs,  capabilities,  and 

opportunities  and  establish  priorities  for  laboratory 
activity . 

Subtask  1.3:   Prepare  plans  for  future  services. 

Subtask  1.4:  Conduct  self-evaluation  of  laboratory  projects 
and  services. 

Task  2^  Work  with  and  through  existing  organizations  to  Improve 
schools  and  classrooms . 

Task  3^  Work  with  State-level  decisionmakers  on  school  Improve- 
ment Issues . 

Task  4^  Work  to  create  research  and  development  based  resources 
for  school   Improvement . 

Task  5^  Work  1n  collaboration  with  centers  and  with  other 

laboratories  on  regional  and  national  education  problems 


Statements 

1 .  Laboratories  focus  on  school  and  classroom  Improvement . 

2.  Laboratories  feature  dissemination  and  assistance  strategies. 
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3.  Laboratories     engage     In     applied  research     and  development 
support  improvement . 

4.  Laboratories  serve  designated  regions. 

5.  Laboratories  have  independent  governing  boards. 

6 .  Laboratories  are  part  of  a  nationwide  system . 
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TASK  STRUCTURE  OF  LABORATORY  PROGRAMS  FOCUSED  ON 
IMPROVING  ADMINISTRATIVE  LEADERSHIP 

The  following  task  structures  are  taken  from  proposals,  which 
generally  contain  the  most  complete  statement  of  rationale  and 
task  structure.  In  many  cases  activities  were  subsequently 
modified  or  deleted.     Numbering  is  that  used  by  each  lab: 

o  AEL ;  School  Administ rat  ion  and  Governance  Program . 

1.  Provide  R&D-based  information  to  school 
administrators . 

2.  Establish  and  operate  State  study  groups. 

3.  Provide  technical  assistance  to  school 
administrators     through       in-State     workshops , 
conferences,  and  SES  sites. 

4.  Plan  and  collaborate  with  other  lab  programs. 

£L  FWL :   Professional  Preparation  and  Development 
3.4  Support  for  school   level  leadership 

3.4.1.  Refine  and  demonstrate  Peer  Assisted 
Leadership  (PAL) . 

3.4.2.  Develop  and  test  a  trainer  of  trainers 
capabl 1 1ty . 

3.4.3.  Examine  special   problems  in  school 
leadership  (one  topic  per  year). 

3.4.4.  Develop  and  implement  summer  leadership 
Institutes  for  practicing  administrators 
and  teacher  leaders . 

3.4.5.  Promote  districts1   options  for  school 
Improvement . 

o  NE/I ;   Leadership  for  School  Improvement 

1.1.  Support  materials  for  school  improvement 
leadership. 

1.2.  The  School   Improvement  Leadership  Network 

1.3.  Research  on  leadership  for  school 
Improvement . 

o  NWREL;   Rural   Networking  for  Leadershi  p 

o  Identify  up  to  three  regional  agencies  that  are 

interested  and  have  good  potential  as  agencies, 
o  Develop  up  to  three  models  for  network  and 

collaboration  development  among  small .. .schools . 
o  Develop  processes  and  materials  for  training 

personnel  from  cooperating  regional  agencies  and 

school s . 
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o  Identify  cooperating  schools  and  establish  up  to 
three  networks  and  test  each  of  the  three  models 
1n  a  network. 

o  Evaluate  the  effectiveness  of  each  of  three 

models  1n  terms  of  Improving  Instruction  In  the 
schools  and  prepare  the  successful  model (s)  for 
dissemination . 

o  Disseminate  and  support  the  Implementation  of 
the  successful  model (s). 

o  RBS;  Organizational  Effectiveness 

1.  Management  development 

2.  Secondary  school  Improvement 

3.  Labor-management  cooperation 

o  SEDL:   Improving  Teacher  and  Administrator  Performance 
C.1.  Investigating  teacher  and  administrator 

performance-assessment       systems      assoc  -fated 
with     Implementing     rewards.     Incentives,  or 
career-  development. 
C.2.   Identifying  and  describing  teacher  and 
administrator  performance— Improvement 
programs     that  couple     performance  assessment 
with  1nserv1ce  education/staff  development. 

o  SEIL:  C.   Improving  Leadership  Skills  of  School 
Principals 

o  Provide  Information  to  practitioners  on  national 
and  regional  resources;  national.  State,  and 
local  Initiatives  and  current  literature;  and 
form  a  regional   resource  network 

o  Design  and  develop  products  and  staff 

development  activities  based  upon  current 
Council  efforts  to  provide  Immediate  application 
to  school  principal  training,  making  use  of  best 
adult  learning  theories. 

o  Collaborate  with  existing  resources  to  secure 
additional  staff  development  materials. 

o  Develop  and  Implement  plans  for  service 

delivery  to  practitioners  through  prlnd palshi p 
academies,  with  assistance  of  State  advisory 
committees . 

o  Provide  technical  assistance  to  Intermediate 
service  organizations  (principal  academies)... 

o  Plan,   Implement  and  evaluate  activities  for 

particular  application  and  effect  upon 
traditionally  underserved  populations,  and 
revise  accordingly. 

o  Coordinate  with  other  lab  projects  to  maximize 
effect . 
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o  Coordinate  with  other  labs  and  centers... 

o  Identify  research  needs  and  recommend  a  school 

principals  research  agenda, 
o  Evaluate  and  revise  plans  to  provide 

direction  for  third,  fourth,  and  fifth  years. 
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APPENDIX  C 
GLOSSARY  OF  ACRONYMNS  AND  ABBREVIATIONS 

ADD  Analysis,   development,   and  dissemination   [model:  Dunn] 

Adm  Administrator 

AEL  Appalachian  Educational  Laboratory 

CIPP  Context,   Input,   program  and  product   [evaluation  model] 
CCSSO     Council  of  Chief  State  School  Officers 

CES  Center  for  Education  Statistics 

CPRE  Center  for  Policy  Research  1n  Education   [Rutgers  U.] 

CSSO  Chief  state  school  officer 

Demo  Demonstration 

DESSI  Dissemination  Efforts  Supporting  School  Improvement 
(Crandall  and  Loucks  1983) 

Dev  Development 

DM  Decisionmaker  4* 

ECS  Education  Commission  of  the  States 

ERIC  Educational  Resources  Information  Center 

Eval  Evaluation 

FWL  Far  West  Laboratory 

GDPA  General  purpose  dissemination  assistance  (Louis  et  al  1984) 

IC  Interorgan izatlonal  col lecti vity 

IEL  Institute  for  Educational  Leadership 

IHE  Insticutlon  of  higher  education 

I OA  Interorgan  izatlonal  arrangement 

ISA  Intermediate  service  agancy 

KP  Knowledge  production 
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KPO  Knowledge  production  organization 

KPU  Knowledge  production  and  utilization 

KU  Knowledge  utilization 

LEA  Local  education  agency 

McREL  M1d  Central   Regional  Educational  Laboratory 

NCREL  North  Central   Educational  Laboratory 

NE/I  The  Reg1  onal  Laboratory  for  Educational   Improvement  of  the 
Northeast  and  Islands 

N6A  National  Governors*  Association 

NIE  National   Institute  of  Education 

NWREL  Northwest  Regional   Educational  Laboratory 

OE  Office  of  Education 

OERI  Office  of  Educational   Research  and  improvement 

RBS  Research  for  Better  Schools 

R&D  Research  and  development 

RDD&E  Research,  development,   demonstration,  and  evaluation 

RDIS  Research  and  Development  Interpretation  Service 

Res  Research 

RS  Regional  Services  [Program] 

RX  Regional  Exchange 

SA  Self -assessment 

SEA  State  education  agency 

SEDL  Southwest  Educ.tlonal   Development  Laboratory 

SEP  State  Education  Policy  [Program] 

SEIL  Southeastern  Educational   Improvement  Laboratory 

SIO  Service  Improvement  organization 

SDO  Service  delivery  organization 
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Tea  Teacher 
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Afttr  extensive  consultation  during 
19M-H  in  preparation  for  a 
^competition  of  then-existing  swards, 
tbt  Department  established  six 
"praoises*',  or  prindploo  on  which 
laboratories  should  optratt.  As  suttd  in 
QERTs  1885  solicitation  of  proposals, 
tneee  premise*  wart  that  tha 
Itboratorits  would:  (1)  Focus  on  school 
and  classroom  improvement  (2) 
emphasize  dissemination  and  ttchnical 
assistanca;  (3)  engage  in  appliad 
rtaaarch  and  development  to  tha  axttnt 
tbat  thtaa  strengthen  laboratory  efforts 
at  school  improvement  (4)  serve 
designated  regions:  (5)  have 
independent  goreming  boards;  and  (6] 
be  part  of  a  nationwide  system. 

These  premises  and  related  policies 
adopted  in  1985  brought  two  particularly 
significant  changes  in  the  laboratory 
program.  The  Ant  was  that  the  large 
scale  product  development  and  apphed 
RAD  that  the  laboratories  had 
participated  in  were  deemphesfeed. 
Rather,  dissemination  and  technical 
assistance  wen  emphasized.  Second  a 
substantial  portion  of  laboratories'  work 
towards  school  improvement  waa 
directed  to  be  delivered  in  accordance 
with  an  indirect  service  strategy. 

Laboratory  services  delivered 
pursuant  tc  this  strategy  since  1985  have 
been  directed  "with  and  through"  a 
variety  of  service  improvement  and 
intermediary  organisations  (e.g.  State 
education  agencies,  education  service 
agencies  and  professional  associations), 
rather  than  directly  to  schools  and 
classrooms.  The  reasoning  underlying 
this  strategy  has  been  that  there  are  too 
many  school  districts,  schools  and 
classrooms  in  the  country  for 
laboratories  to  work  with  evens 
significant  portion  of  them  ds**ctly. 
Working  with  intarmadiaries  through  tha 
indirect  strategy  has  thus  baea  designed 
to  leverage  and  extend  the  benefits  of 
laboratory  funding*  However,  not  all 
laboratory  wock  is  delivered  through  the 
indirect  strategy.  Laboratories  may  week 
with  local  districts  and  schools  under 
specified  conditions:  they  also  serve 
Ststs  decisionmaker  needs  directly  with 
^  portkm  of  their  funds.  Hie  various 
strategies  for  delivery  of  lab  services 
will  bo  reconsidered  as  part  of  planning 
for  the  recompettttoL 

Fiscal  Year  1889  fending  for  the 
program  is  822.1  mfllioiL  This  amount 
indadee  8U  mflBea  in  spedal 
appropriations  far  a  laboratory  rural 
initiative.  Tke  present  laboratory 
contracts  expire  on  November  3a  19M. 
Thefortbcootiagrecompetitioowil 
ine  what  organisations  will 
i  laboratories  Jo  tha  funding 


Tha  laboratory  regions  and  the 
present  contractors  are  listed  below. 


iter.  MA. 
ML  NH  NY.  ML  VT. 


Va«a  laiaads*  aad 


M*AUantfc{DtDC 
MD,  NJ.  and  FA). 


(KY.TN. 
VA.aadWVV 


ifAL.n. 
GA.M&.NC.M4 

SQ. 

Central  (Cars.  MO. 
NE.ND.SD.and 

Sondnaaatara  (AIL  LA. 
NM.OK.aadm 


ty.  Baaaaica  Xnaanja 

HA.HJC 

MM  aatiaart  fttftona) 
Edacittonal  Labors*, 
ry.  Aarora.  Coiarada 

Sottkwwt  Krtyrartawal 
Dsvaiopmaat  U  ban  lo- 
ry, Aottm.  Taxaa. 

Nate  Ctatral  RaaJanal 


fjr.  Ela&unl  Uuaaia, 
Far  Wait  Uboratory  lor 


im.tN.lA. 
MLMN.OK  WI). 

Warfare  (At  CA.  NV. 
aadtm. 


North  wttttni  (AX.  ID.    Nona  watt  mm  mil  Ida- 

MT.  OR.  and  WA).  ^ 


Pacific  Baato*  (HA  i 
Ptdfic  Insular 
Aim*). 


NartlwHsai  , 
cauooal  Laboratory. 
Portland.  Oraaoa. 


noaamr.  taa  Nortaawat  ■3LZLt'll!!1L*  g* 


adiaaarva  thai  _  

afaajaradaaa  taaralir  a  aaS 
*****  teat  •  mm*  awart 

will  ba 


and  auppart 

».  h  it  t*. 


AaHaaJij  SOU  AC  1221a. 
Datofcjm2lisas. 

V.I 


Acting  Assistant  Secretary  for  Educe  tionaf 

Hsssanh  and  Anpror  amcnt 
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r.Thi*  notice  provides  tht 
schedule  tad  background  information 
for  Art  opto  meetings  being  conducted 
in  preparation  for  the  recompetition  of 
regional  tducational  laboratories  funded 
by  the  Office  of  Educational  Research 
and  Improvement  (OEM). 

OATtg,  AOOMgggg  AMD  TtMU: 

June  26.  1989.  OEM.  955  New  Jersey 
.  Avenue  NW„  Room  328,  Washington. 
DC  9s00  a  jn.  to  11:45  e  jn. 

June  27. 1990.  OERL  555  New  Jersey 
Avenue  NW„  Room  326,  Washington. 
DC  fcOO  sjxl  to  11:45  a  Jn. 

July  19. 1989.  Kansas  City  Airport 
Marriott  Hotel.  775  Brasilia  Avenue. 
Kansas  City.  Missouri  9*0  a  on.  to 
12.-00  Noon;  1.-00  pjn  to  4:00  pjn. 

July  19. 1989.  OERL  555  New  Jersey 
Avenue  NW..  Room  328.  Washington, 
DC  930  ajn.  to  12.-00  Noon;  1:00  pjn. 
to  4.-00  pjn. 

July  21. 1989.  San  Francisco  Airport 
Hilton  Hotel  San  Francisco 
(California)  International  Airport  MO 
a  jn.  to  11-00  Noon:  1:00  p.m.  to  4.-00 
p.m- 

POH  PURTMtn  INPOftlAATIOM  CONTACT! 

Ms.  Adria  White.  Office  of  Educational 
Research  and  Improvement  U.S. 
Department  of  Education.  555  New 
Jersey  Avenue  NW..  Room  502. 
Washington.  DC  20208-5844.  Telephone 
(202)387-8161. 

•ummeirr  aay  umomumom  The 
Office  of  Educational  Research  and 
Improvement  (OEM)  is  preparing  for  z 
recompetition  of  regional  educational 
laboratories  in  1990.  In  preparation  for 
this  competition.  OEM  is  seeking  views 
and  advice  from  the  field  about 
educational  needs  and  problems  in  die 
United  States  and  how  laboratories  can 
help  respond  to  them. 

OEM  will  hold  five  open  meeting*,  to 
help  plea  for  the  recompetition. 
Representatives  of  major  educational 
associations  end  other  organisations 
have  been  invited  to  present  their 
individual  views  about  the  future  of  (he 
regional  laboratory  program  et  the 
meetings  to  be  held  e  t  OEM  on  June  28 
end  June  27.  These  two  meetings  will  be 
identical  in  purpose  and  format  bat  the 
invited  participants  will  be  different 

The  next  three  meetings,  two  on  July 
16  and  one  on  July  21.  will  be  not> 
invitationai  at  which  members  of  the 
public  including  State  and  local 
officials,  educatots,  and  privete  citizens, 
may  prseent  statements  to  OEM 
officials  about  the  regional  laboratory 
.  Written  statements  from  the 


public  forwarded  directly  to  OEM  by 
July  21. 1989,  in  response  to  this 
announcement  also  will  be  considered 
in  planning  for  the  recompetition. 

Format  of  the  Meetings 

At  the  two  invitational  meetings  on 
June  28  and  June  27.  OEM  officials  will 
make  brief  introductory  statements. 
Invited  representatives  of  the 
educational  associations  and 
organizations  will  make  statements 
about  the  laboratories,  reflecting  the 
views  of  their  various  constituencies. 
(Further  details  about  issues  which  may 
be  discussed  ere  provided  below.)  The 
public  may  attend  and  listen  to  the 
presentations  made  in  these  two 
meetings. 

At  the  three  non-invitational  meetings 
on  July  19  and  July  21,  following 
introductory  statements  by  OEM 
officials,  members  of  the  public  will 
make  statements  about  the  laboratories. 
All  public  statements  will  be  limited  to 
10  minutes  each.  Persons  speaking  will 
be  esked  to  submit  written  cootes  of 
their  statements  et  the  meetings. 
(Written  statements  from  persons  not 
attending  the  meetings  may  also  be 
submitted  directly  to  OERL  ee  indicated 
above.) 

How  To  Participate 

Persons  wishing  to  ettend  any  of  these 
meetings,  or  participate  in  the  non- 
invitational  meetings,  should  contact  the 
OEM  meeting  coordinator.  Ms.  Adria 
White,  et  (202)  357-618t  or  write  to  her 
et  the  address  above.  Anyone  appearing 
at  e  non-invitational  meeting  to  speak 
without  previously  scheduling  e  time  in 
advance  with  Ms.  White  will  be 
assigned  e  10  minute  time  interval  that 
day.  if  timt  is  available. 

Major  Issues 

OEM  is  seeking  views  and  advice 
from  the  public,  especially  on  the 
following  questioner 

1.  What  activities  conducted  by 
regional  educational  laboratories  have 
bean  moot  valuable  in  the  past  2-3 
years? 

2.  How  can  regional  laboratories 
contribute  to  improving  performance  of 
oar  educational  system  what  are  the 


OEM  will  also  eccept  edvice  on  other 
issues  related  to  the  future  of  the 
laboratory  progem. 


key  issues  and  problems  they  should 
focus  on  in  the  foture? 

3*  What  kinds  of  laboratory  activities 
end  strategies  (o*,  syntheses  end  other 
reeearch  and  development  (RAD) 
products,  direct  technical  eseistance, 
training  and  capacity  building,  etc.) 
would  be  most  beneficial  in  *E§  future? 

4.  What  form  of  relationship^) 
between  laboratories  and  organizations 
or  other  persons  seeking  improvement  in 
schools  would  be  moet  effective? 

915 


Additional  Information  That  WIU  Be 
Available 

Hie  ILS.  Department  of  Education 
plans  to  issue  e  solicitation  lets  ir  1969 
for  proposals  to  operate  regional 
laboratories  in  the  funding  period 
beginning  December  1 199a  Proposals 
will  be  due  in  the  early  Spring.  1990.  The 
exact  dates  for  these  events  will  be 
announced  ..iter  this  Summer.  This  end 
other  information  related  to  OEM's 
planning  for  the  regional  laboratory 
recompetition  may  be  obtained  es  it 
becomes  available  by  contacting  Ms. 
Adria  White  et  the  address  or  telephone 
number  provided  above.  Among  the 
items  to  be  made  available  are: 

1.  Commissioned  papers  end  reports 
ebout  the  regional  laboratory  program 
(some  ere  currently  available); 

2.  A  written  synthesis  end  verbatim 
transcripts  of  the  two  invitational 
meetings,  plus  verbatim  transcripts  and 
statements  submitted  to  OEM  in 
connection  with  the  non-invitational 
meetings: 

3.  Final  announcement  of  the 
solicitation  end  award  schedule  end  e 
copy  of  the  solicitation  itself. 

Information  About  the  Laboratory 


Hie  regional  laboratory  program  wee 
established  in  1965  to  help  get  the  best 
available  knowledge  ebout  improved 
practices  end  methods  into  the  nation's 
classrooms.  Laboratories  were  to 
develop  and  disseminate  this  knowledge 
end  provide  training  and  technical 
eseistance  in  its  application.  Twenty 
laboratories  were  originally  established 
although  there  wae  no  systematic 
delineation  of  die  regional  boundaries 
for  their  services.  At  present  nine 
regional  laboratories  serve  all  50  States, 
the  District  of  Colombia,  Puerto  Rico, 
the  Virgin  Islands  and  Pacific  Island 
entities. 

The  program  is  now  authorized  by 
section  406(d)(4)  of  the  General 
Education  Provisions  Act  (GEPA),  es 
emended  (20  ILS.C  Iffla).  Section 
406(dX4XAXi)  of  GEPA  provides  that 
regional  laboratories  must  be 
"established  by  public  agencies  or 
privete  nonprofit  onaniietions  to  serve 
the  needs  of  a  specific  region  of  the 
nation  under  the  governance  of  e 
regionally  representative  governing 
board9  9  V  The  regulations  for  the 
program  are  contained  in  34  OFR  Parts 
708  and  707  (53  FR  30790  (August  13, 
0- 


ft 
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Terry  Udell 
Executive  Director 
-Appalachla  Educational 
Laboratory*  Inc. 
1031  Quarrlor  Straat 
Charleston,  Naat  Virginia  25325 
(304)  347-0400 
OERI  Institutional  Liaison: 
Richard  Lallnang  (202)  357-6274 


Plan  B.  Nafxlger 

Executive  Director 

far  Naat  Laboratory  for  Educational 

Research  and  Development 
1358  Foleoa  Street 
San  Francisco,  California  94103 
(418)  865-3000 
OERI  Institutional  Liaison: 
Cheryl  earnette  (202)  357-6267 

Lawrence  Hut  chins 
Executive  Director 
Mid-Continent  Regional 

Educational  Laboratory 
Suite  201 
12800  Bast  Illf f 
Aurora,  Colorado  80014 
(303)  337-0990 
OERI  Institutional  Liaison: 
Carol  Mitchell     (202)  357-6128 


Jerl  NowekSMSkl 

Interim  Executive  Director 

North  Central  Regional 

Educational  Laboratory 
296  Earoy  Avenue 
Slahurst,  Illinois  60126 
(312)  941-7677 
OERI  Institutional  Liaison: 
Lois  Weinberg      (202)  367-6147 


David  P.  Crandall 

Executive  Director 

Regional  Laboratory  for 

Educational  Improvement  of 
the  Northeast  and  Islands 

290  South  Main  Strsst 

Andovsr,  Massachusetts  01810 

(808)  470-0098 

OERI  Institutional  Liaison: 

John  Bgermeler  (202)  357-6119 

John  E.  Hopkins 
Executive  Director 
Research  for  Better  Schools 
444  North  Third  Strset 
Philadelphia,  PA  19123 
(215)  574-9300 
OERI  Institutional  Liaison: 
Susan  Talley  (202)  357-6129 


Char lee  J.  Law,  Jr. 
Executive  Director 
Southeastern  Educational 

Improvement  Laboratory 
P.O.  Box  12748 
200  Park  Offlcee,  Suite  200 
Research  Triangle  Park, 

North  Carolina  27709-2748 
(919)  649-8216 
OERI  Institutional  Liaison: 
John  Couleon    (202)  387-6133 

Preston  Eronkosky 
Executive  Director 
Southwest  Educational 

Development  Laboratory 
211  East  Seventh  Street 
Austin,  Texas  78701 
(812)  476-6861 
OERI  Institutional  Liaison: 
Carter  Collins    (202)  387-6121 


Robert  Rath 
Executive  Director 
Northwest  Regional 

Educational  Laboratory 
101  S.N.  Main  Street,  Suite  800 
Portland,  Oregon  97204 
(803)  278-9600 
OERI  Institutional  Liaison 
Marshall  Saahkln    (202)  337-6120 


For  Laboratory  Program 
Information,  Contact: 

Barbara  Lleb-Brllhart 
Team  Leader 

Regional  Educational  Laborator 

Program 
888  New  Jerssy  Avenue,  N.W. 
Washington,  D.C.  20208-3644 
Phone:     (202)  387-6168 


ACT*l*9hl*  fffluc«t4onml  Laboratory 
.1031  Quarrier  Strttt 
Charleston,  Nnt  Virginia  25325 
Phone:  304-347-0400 

Kxscutlve  Dlractor:  Or.  Tarry  E Ida 11 

Chair.  Board  of  Dlractora:  Dr.  Hanry  Marockie,  11/87-11/89 

Superintendent ,  Ohio  County  Schools 

2203-5  Rational  Road 

Wheeling,  Neat  Virginia  26003 

304-243-0300 

Areas  Served;  Kentucky,  Tennessee,  Virginia,  and  West  Virginia 

I*    Maior  Actlvltlaa 

o       Claaarooa  Instruction  (CZ)  atraaaaa  tha  improvement  of 
taachlng  and  laarnlng  In  K-12  classrooas  in  tha 
Region.    It  works  primarily  through  taachar 
associations  In  aach  state. 

o       School  Govarnanca  and  Administration  (S6A)  strass 

laprovamant  of  K-12  schools  In  tha  Raglon  by  working 
with  and  through  associations  of  administrators  and 
achool  board  members. 

o       Policy  and  Planning  Cantar  (PPC)  oparatas  as  a 

machanlsm  for  maximizing  long-tarm  involvamant  by 
stats  officials  In  actlvltlaa  daalgnsd  to  fostar  an 
inquiry- bee  ad  approach  to  decisionmaking. 

o       Profasslonal  Prsparatlon  and  Research  (PPR)  Involves 
work  with  tha  Raglon 'a  hlghar  education  Institutions 
to  help  schools  dsrlva  banaf It  from  locally  available 
R&D  rasourcee. 

o       Tha  Rsglonal  Liaison  Cantar  (RLC)  maintains  working 
ralatlonshlps  with  undar-raprasantad  groups  in  tha 
raglon 'a  urban  araaa  and  haavlly  population  minority 
areas,  and  provides  networking  opportunities  for 
groups  of  parents,  community  groups  and  achool a  to 
plan  school  Improvement  projects. 

o       Tha  School  Services  Center  (SSC)  provides  needy  acceas 
to  Information  services?  conducts  short-term  R&D 
activities;  and  coordinates  the  lab 'a  needs 
assessment,  documentation,  and  evaluation  activities. 


o       Rural  Small  School*  Program  (RSS)  operates  to  Involve 
rural  educators  and  community  aeabers  together  In 
school  laprovement.    The  RSS  program  Is  testing  a 
model  of  school -community  partnership  in  four  sites 
around  the  region;  building  a  regional  information 
base;  testing  a  process  to  enable  schools  and 
communities  to  make  decisions  based  on  data;  and 
actively  participating  in  and  supporting  the  work  of 
professional  associations  concerned  with  rural 
education. 

ZZ.  Mel  or  Accomullahmentr, 

Students : 

o       Zapacted  the  decision  of  73  children  in  the  original 
preschool  education  project  to  stay  in  school  and 
eventually  graduate  from  B5gh  School.  Through 
television  programs  and  personal  Interaction  with 
parents,  the  HOPS  project  promoted  expectations 
between  parents  and  children  for  a  continuing,  healthy 
relationship  with  school  faculty  and  staff.  (Annual 
report  F?  88  p.  90) 

Parents: 

o       Demonstrated  a  method  for  Increasing  parent 

Involvement  through  one  component  of  a  model  for 
improving  home-school  communications  in  Norfolk, 
Virginia;  set  up  a  tutoring  pi  gram  with  assistance 
from  Rdrfolk  State  University  (HSU)  and  conducted  an 
all-day  training  session  for  parents  in  both  tutoring 
and  training  skills.    These  parents  trained  other 
parents  to  be  tutors  in  the  comau^icy  tutoring 
program.    This  effort  resulted  in  dramatic  Increases 
in  parent  Involvement. 

o       Developed  an  Instrument  to  measure  parent  Involvement 
in  school  laprovement  Initiatives,  and  pilot  tested  it 
in  Bart  County,  Kentucky,  with  good  results. 

Teachers  and  administrators: 

o       Spr^sored,  with  various  teacher  and  administrator 
associations,  tralning-for-tralnere  on  a  number  of 
topics,  including  at-risk  students;  first  tlsr 
trainers  assisted  in  a  Virginia  teleconference  in  May 
1988  Involving  150  second-tier  trainers  (teachers  and 
administrators  who  will  replicate  the  training  at 
their  local  schools)  in  nine  sites  across  the  st^te. 


o       Addressed  the  problsas  of  tsacher  Isolation  and  lack 
of  dlrsct  lnvolvaasnt  in  school  Improvement  efforts  In 
a  national  project.    The  MBA  Mastsry-ln-Lsamlng  (MIL) 
project  links  teachers  In  school  laproveaent  efforts 
to  educational  research  and  development  products  and 
services. 

o       Created  and  provides  technical  assistance  to  28  study 
groups  as  an  approach  to  working  with  and  through 
other  associations.    Counselors,  teachers, 
administrators,  university  professors,  or  a  six  of 
these  Individuals,  depending  on  what  the  study  topic 
Is,  coaprlss  the  group.    Bach  study  group  assimilates 
research  and  practice  Into  a  meaningful  document  that 
can  be  used  In  the  field  by  education  practitioners. 

o       Responded  since  1986  to  4,818  requests  for  materials, 
resulting  In  the  dissemination  of  84,043  documents  and 
processed  862  Information  search  requests. 

Pollcyaaksrs 

o       Developed  eleven  Issue  synthesis  papers  for 

policymakers.  More  than  4,600  copies  of  these  papers 
have  been  distributed  at  the  request  of  policymakers. 

o       Impacted  etate  legislation.    Early  In  PY87,  an  ABL 

Professional  Preparation  and  Ressarc*  program  project 
agreed  upon  a  clinical  faculty  model  to  replace 
conventional  supervision  of  undergraduate  student 
teaching,  based  on  a  pilot  program  developed  by  the 
University  of  Virginia,  the  Idea  was  presented  to 
members  of  the  stats  legislature.    Both  houses  of  the 
Virginia  legislature  approved  the  Clinical  Faculty 
Bill  (BB1616)  without  dissent,  and  the  bill  was  signed 
Into  law  by  the  governor. 

III.    Principal  Products: 

a )    Bewslet t ere : 

o     The  Link,  a  quarterly  neweletter,  contains 

announcements  of  upcoming  events,  education  news 
from  ABL  member  etatee,  and  reports  on  education 
research.    Special  four  or  eight-page 
program  -specific  Inserts  are  directed  to 
different  audiences—  teachers,  administrators, 
local  school  board  members,  higher  education 
faculty,  educators  In  rural  sad  small  schools, 
and  etate  level  policymakers.    8,000  per  Issue 
are  distributed. 
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b)  Knowledge  Syntheses: 

o  Developmental  Teaching:  A  Cognitive  Approach  to 

Improving  Student  Achievement.  (Occasional  Paper 
027),  Prepared  by  Edwlna  D.  Pendarvls  and  Almee 
Howley,  November,  1988. 

o  The  Effectiveness  of  the  Study  Group  as  an  R&D 

Methodology,  by  J.  Barnette,  D.  Smith,  and  B. 
Burch,  November,  1987.  (Occasional  Paper  No. 
025) 

o  The  Changing  Context  of  Education  In  a  Rural 

Setting,  by  E.  Robert  Stephens,  (Occasional  Paper 
26)  November,  1988.  . 

c)  Policy  Papers: 

o  Categorical  Certification  In  Special  Education: 

Does  It  Really  Make  a  Difference?,  by  Margaret  J. 
McLaughlin  and  Barbara  Stettner-Eaton,  October, 
1988. 

o  Professional  Standards  for  Teaching;  The 

Assessment  of  Teacher  Knowledge  and  Skill,  by 
Gary  Sykes  and  Suzanne  M.  Wilson,  August,  1988. 

o  Preklnderoartan  Programs  In  Public  Schools:  A 

National  and  state  Review,  by  Susan  L.  Trostle 
and  Barbara  Merrill,  November,  1986. 

d)  Training  and  Development  Resources: 

o  Teacher  as  Decisionmaker  —  An  AEL  School 

Excellence  Workshop.  AEL,  July,  1987. 

o  Educational  Goals  Workshop;  What  a  Difference  a 

Goal_Makes,  AEL,  September,  1987. 

o  Effective  Questioning  Workshop;  Good  Questions 

Don't  Just  Happen.  AEL,  October,  19*7. 

e)    Specialized  Products: 

o  Disparities  In  Curriculum  Offerings:  Issues  and 

Policy  Alternatives  for  Small  Rural  Schools,  by 
David  fl.  Monk,  August,  1988. 

o  A  Demographic  Study  of  Rural.  Small  School 

Districts  In  the  Appalachian  Region,  by  Merrll  L. 
Meehmn,  November,  1987. 
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TEA-AEL  Parent  Education  Notebook,  a  1986  study 
group  product  (Tennessee  Education  Association) , 
provides  activities  for  teachers  to  distribute  to 
parents  to  enhance  their  children's  developnent 
In  six  skill  areas.    The  notebook  has  been  the 
aost  requested  ABL  study  group  product  to  date 
Cover  1,100  copies  have  been  disseminated)  and  It 
has  been  selected  for  Inclusion  In  ERIC. 

Results  of  First  Stage  Field  Taatlna  of  a 
Preferred  Design  for  Organizational  Effectiveness 
Studies  of  Rural.  Small  Schools,  (a  paper 
presented  at  AERA) ,  April,  1988,  by  Willis  J. 
Perry,  Jr.,  John  R.  Sanders,  and  B.  Robert 
Stevens. 

Programs  of  Promise;  A  g»""«ry  of  Current 
Programs  Focusing  on  the  Recruitment  of  Minority 
Candidates  to  Careers  In  Professional  Education, 
by  The  Tennessee  Association  of  Colleges  of 
Teacher  Education  and  Appalachla  Educational 
Laboratory  Study  Group,  March,  1988. 
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Far  West  Laboratory  for  Educational  Research  and  Development 

1855  Poison  Street 

San  Francisco,  California  94103 

415-565-3000 

Dr.  Dean  H.  Nafzlger,  Executive  Director 
Dr.  Raymond  S.  Kellis 

Chairman,  Board  yf  Directors,  9/88  -  9/89 
Superintendent,  Peoria  Unified  School  District  No.  11 
P.O.  Box  39 
Peoria,  AZ  85345 
602-878-1028 

Areas  Served:    Arizona,  California,  Nevada,  Utah 


Major  Activities 


o     Teaching  and  Learning,    This  program  focuses  on  enhancing 
student  thinking  and  working  skills.  The  core  efforts 
Include:  1)  developing  training  modules  to  enable  middle 
school  teachers  to  facilitate  student  thinking  and  writing 
skills;  2)  serving  as  a  resource  In  the  region  for  effective 
teaching  strategies  and  practices;  3)  providing  Inservice 
training  and  consultation  to  science  teachers  and  SEA 
personnel;  and  4)  conducting  workshops  to  Improve  the 
self -directed  learning  of  at-risk  elementary  school 
students • 

o      Improving  Organizational  Effectiveness,    FWL  works  with 

local  and  state  education  agencies  to  build  their  capacities 
to  Identify  and  Implement  strategies  for  Improving  school 
effectiveness.    Tasks  Include:    1)  conducting  pilot  tests  of 
systems  analysis  Instruments  developed  last  year  and 
developing  resource  materials  to  assist  school 
administrators  to  review  and  select  change  strategies  based 
on  the  assessment  data;  and  2}  providing  technical 
assistance,  txalnlng  and  support  to  state  education  agencies 
and  educational  service  centers  In  the  region  to  Implement 
school  Improvsment  plans. 


Professional  Preparation  and  Development.    Projects  under 
this  theme  Include:    1)  providing  effective  training  and 
support  for  beginning  teachers;  2)  preparing  teachers  for 
work  with  the  diverse  student  populations  within  the  region; 
3) supporting  school-level  leadership  for  teachers  and 
principals;  and  4)  providing  state-level  decisionmakers  with 
currant  Information  about  alternative  approaches  to  funding 
and  Implementing  staff  development  programs. 

Students  at  Ulsk.    FWL  Is  responding  to  this  critical 
service  need  by  1)  establishing  Itself  as  a  regional 
resource  center  for  Information  and  services  for  at-risk 
youth;  2)  disseminating  Information  about  partnerships 
between  urban  schools  and  businesses;  3)  documenting  the 
success  Indicators  of  Instructional  programs  for  at-risk 
students;  and  4)  designing,  Implementing  and  documenting  an 
Intensive  early  Intervention  program  and  longitudinal  study 
using  the  model  employed  by  the  Syracuse  University 
Children's  Center. 


.  e     Rural  and  Small  Schools.    Under  the  auspices  of  the  Rural 
Schools  Assistance  Center,  FWL  developed  a  program  of 
regional  services  aimed  at  1)  Informing  rural  practloners  of 
available  resources  and  promising  practices,  2)  strenghenlng 
rural  partnerships  and  developing  networks,  and  3)  directly 
assisting  school  Improvement  efforts  at  both  the  district 
and  state  level.  * 

Ma^or  Accomplishments 

O     FWL  collaborated  In  school  Improvement  efforts  that  Involved 
all  four  state  departments  cf  education;  all  58  county 
offices  of  education  In  California;  Utah's  four  regional 
service  agencies;  13  other  state  agencies,  associations,  or 
consortia  across  the  four  states;  and  70  school  districts 
ranging  from  some  of  the  largest  to  some  of  the  smallest  In 
the  region. 

o     FWL  convened  more  than  170  business,  civic  and  education 
leaders  from  the  four-state  region  for  a  discussion  of  the 
vital  roles  schools  play  In  urban  economic  development.  The 
conference  was  co-sponsored  by  FWL  and  the  ERIC 
Clearinghouse  on  Urban  Education,  Teachers  College,  Columbia 
University.    Twelver  panel  discussions  highlighted  business 
and  Industry  expectations  of  schools,  strategies  for 
developing  partnerships  between  schools  and  businesses,  the 
critical  role  of  higher  education  In  strengthening  urban 
schools,  and  critical  Issues  for  urban  educators  to  consider 
In  preparing  for  the  future. 

o  In  Levis  County  Utah,  FWL  completed  a  descriptive  aturty  of 
s  highly  popular  elementary  curriculum  called  Workshop  Way. 
This  descriptive  study  and  a  needs  assessment  survey  of  757 
teachers  in  the  district,  will  allow  the  district  to  better 
Implement  and  support  the  curriculum.  In  addition,  the 
study  draws  general  conclusions  about  how  teachers  can  help 
sutdents  develop  their  own  responisbility  for  learning,  a 
key  concern  of  educators  throughout  the  region. 

o      In  Washoe  County  (Reno),  Nevada,  FWL  worked  with  a  study 
group  of  eight  teachers  to  design  and  Implement  an 
Intervention  to  Improve  student's  self-directed  learning  In 
science.    Classroom  techniques  and  materials  f c ?  students 
are  Incorporated  In  a  self-Instructional  manual  for  teachers 
and  teacher  trainers  which  guides  teachers  from  diagnosis  of 
student  learning  difficulties  through  targeted  classroom 
Instruction  to  monitoring  and  feedback.    Some  teachers  were 
quite  successful  In  helping  students  to  change  the  way  they 
learn  and  study. 

o     FWL  created  a  rich  set  of  resource  materials  to  help  the  Los 
Angeles  Unified  School  District  train  Its  900  mentor 
teachers.    These  documents  are  now  used  by  the  district's 
Professional  Development  Center  In  training  Its  mentor 
O  "teachers  to  guide  and  assist  the  district's  3000  new 

ERIGcnchers  each  year. 


o     By  1988,  fourteen  periodical  publications  had  been  mailed  to 
9,530  public  schools,  1,889  private  schools,  4,269 
superintendents,  board  presidents  and  central  office  staff 
In  local  school  district  offices,  498  superintendents  and 
staff  In  Intermediate  education  agencies,  89  heads  or  staff 
In  schools,  colleges  or  departments  of  education,  and  the 
chief  state  school  officers,  and  154  state  department  of 
education  staff.    Three  policy  briefs  were  sent  to  1,254 
persons  and  a  rural  newsletter  was  sent  to  *  772  persons. 

Principal  Products 

a.  Newsletters 

Policy  Brief,  published  quarterly  and  distributed  to  1,254 
policymakers  and  legislative  staff  In  the  region. 

Resources  and  Practices,  published  quarterly  and  distributed 
to  16,546  public  and  private  schools,  superintendents,  board 
presidents,  central  office  and  Intermediate  education  agency 
staff,  Institutions  of  higher  education  faculty  and  deans, 
chief  state  school  officers,  and  state  department  of 
education  staff. 

b.  Knowledge  Syntheses 

Cooperative  Learning  In  thg  Classroom.  John  Mergendoller  and 
Martin  Packer,  November  1988. 

Sketches  Information  Brief  on  Educational  Research: 
Computers  for  All  Children.  October  1986. 

c.  Policy  Papers 

Student  Assessment  Programs  In  the  Western  Region.  May  1987. 

Student  Dropout  Problem:    Implications  for  Policymakers, 
Fall  1987. 

d.  Training  and  Development  Resources 

The  Mentor  Teacher  Casebook.  Edited  by  Judith  Shulman  and 
Joel  Colbert,  published  by  PWL  and  the  ERIC  Clearinghouse  on 
Educational  Management,  University  of  Oregon,  November  1987. 

The  Intern  Teacher  Casebook .    Edited  by  Judith  Shulman  and 
"Programs  for  Preparing  Teachers  for  Working  with  Diverse 
Student  Populations."    Beverly  Cabello  and  Roger  Dash. 
September  1988. 

Teaching  for  Scientific  Literacy  Trainer's  Manual.  Alexis 
Mltman,  John  Mergendoller  and  Steven  Schneider,  November 
1988. 


SP«ci«llz>d  Product* 

Special  Reviews  In 'Leadership:    The  Principal  and  Secondary 
School  Improvement ,  Summer  1987 . 

The  Redesign  of  Education;    A  Collection  of  Papers  Concerned 
with  Comprehensive  Educational  Reform,  Volume  1«  December 
1988. 

Procrrame  for  Preparing  Teachers  for  Working  with  Diverse 
Student  Populations.  Beverly  Cabell o  and  Roger  Dash, 
December  1988. 


Mid-Continent  Regional  Education  Laboratory  (McREL) 
12500  E  Iliff  Avenue 
Aurora,  Colorado  80014 
Phone:     (303)  337-0990 

Executive  Director:     C.L.  Hutchins 

Chair,  Board  of  Directors,  12/86  -  11/90 
John  Prasch 

Professor  of  Educational  Administration 
University  of  Nebraska 
Teachers  College  Building,  Room  208 
Lincoln ,  Nebraska  68510 

Areas  Served:      Colorado,   Kansas,   Nebraska,   Missouri,  Wyoming,. 

North  Dakota,  and  South  Dakota 

Major  Activities 

McREL 's  activities  are  organized  under  the  following  tasks: 

o  •  School  Improvement  Program.  This  program  focuses  on 
direct  improvement  of  education  practice.  The  work 
Includes:  1)  producing  and  disseminating  R&D  based 
information;  2)  supporting  regional  school -improvement 
networks;  and  3)  providing  technical  assistance  and 
training  that  strengthens  capacity  of  state  systems  to 
improve  schools. 

o  State  Policy  Program.  This  program  is  designed  to 
strengthen  the  region's  capacity  to  develop  and 
implement  policies  that  support  school  improvement. 
The  work  includes:  1)  develpping  and  maintaining  a 
regional  policy  data  base  for  use  in  creating 
information  products  to  disseminate  to  state  education 
policy  makers ;  2 )  participating  in  networking 
activities  with  state  policy  leaders;  and  3)  providing 
policy-related  technical  assistance  to  state  systems  of 
education. 

o  Education  Redesign.  McREL  is  working  with  with  issues 
of  how  education  must  be  restructured  to  meet  21st 
Century  needs.  A  set  of  activities  include  sponsoring 
international  conferences  on  the  future  of  education, 
developing  new  resources  including  state-wide 
strategic  plans  for  education  change,  developing  and 
svaluating  ways  to  accellerate  student  outcomes, 
demonstration  sites  that  test  direct  interventions  in 
current  school  practices ,  inventing  and  assessing 
systems  for  measuring  student  learning,  teacher  change 
and  the  effectiveness  of  student  and  school  level 
interventions,  and  spearheading  collaborative  work  with 
$        two  other  laboratories  on  the  theoretical  underpinnings 
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of  human  system  redesign. 


o  Rural  and  Small  Schools,  McREL  sponsors  a  variety  of 
projects  to  address  specific  weaknesses  in  rural  areas. 
These  Include:  1)  increasing  student  access  to 
information  about  post  secondary  choices  (Project 
Access);  helping  schools  organize  themselves  to  expand 
course  offerings  through  collaboration  and  technology 
(Decisions  about  Technology  Project);  and  3)  exper- 
imenting with  how  the  school  can  be  a  focus  for 
community  economic  development  (Rural  Schools  and 
Community  Development  Project).  In  addition , 
professional  isolation  for  rural  teachers  and 
administrators  is  reduced  by  collecting  and  sharing 
promising  rural  practices,  supporting  a  database  on 
rural  education  and  circulating  rural  education 
information. 

Major  Accomplishments 

o  Provided  extensive  assistance  to  the  state  of  North 
Dakota  to  develop  a  strategic  plan  designed  to 
establish  a  clear  sense  of  mission  and  focus.  The 
strategy  planning  process  was  the  catalyst  for  the 
input  of  ten  state  task  forces  involving  virtually 
every  legislative  ajid  educational  group  in  the  state, 
and  will  culminate  in  a  North  Dakota  education  agenda 
for  the  future  which  will  include  legislative 
proposals,  program  recommendations  and  a  framework  for 
curriculum  and  instruction.  Recommendations  are  likely 
to  address  schools  organization,  school  finance, 
coordination  among  the  systems  and  teacher  and 
administrator  training. 

o  Provided  technical  assistance  and  support  over  the 
past  several  years  to  help  the  Missouri  state 
department  of  education  revise  and  improve  its 
reviewing  and  classl f ying  publ ic  schools .  The  new 
thrust  is  toward  a  process  ( teaching  and  learning 
dynamics )  and  outcome  approach  ( evidence  of  Improved 
learning)  to  defining  quality  education  rather  than 
input  characteristics.  The  reform  of  the  school 
classification  system  has  potential  for  widespread 
educational  improvement  in  the  state  of  Missouri  and 
would  shift  the  role  of  the  State  Department  of 
Education  from  one  of  monitoring  to  providing 
assistance . 

o  Networks  and  serves  as  a  broker  of  agencies  and 
resources,  particularly  in  rural  small  schools  in  the 
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region.  For  example,  McREL  has  provided  assistance  to 
help  small  school  districts  form  clusters  in  order  to 
increase  their  problem  solving  capacity  through 
collectively  sharing  resources  such  as  developing  joint 
staff  development  programs,  sharing  specialized  staff 
and  alternatives  to  delivering  curriculum  through  the 
use  of  technology,  and  distance  learning. 

o  Developed  the  Rural  School  and  Community  Development 
Project  in  collaboration  with  the  Black  Hills  School 
Cooperative  in  South  Dakota.  McREL  provides  support 
and  technical  assistance  to  eight  rural  schools  and 
community  development  sites  in  South  Dakota  to 
restructure  the  high  school  curriculum.  The  project  is 
creating  new  relevance  by  including  the  community  as 
the  focus  of  study  and  teaching  students  how  to  create 
jobs  and  begin  their  own  businesses,  thereby  improving 
local  economies. 

o  Provided  technical  assistance  to  staff  members  of  the 
Kansas  State  Department  of  Education  on  collaboration 
and  coordination  in  planning  and  delivering  staff 
development  and  technical  assistance  to  local  education 
agencies . 

o  Disseminated  Information  through  its  publications, 
which  present  research-based  concepts  in  a  practical, 
easy  to  read  style  to  help  educators  keep  in  touch  with 
the  growing  literature  on  school  improvement.  McREL 
tailors  one  of  IL'S  publications  directly  to  teachers 
Last  year  McREL  disseminated  more  than  7Q,.0Q0  copies  of 
publ i  ca t i ons • 

Principal  Products 

a.  Newsletters 

McREL  Up-Date  is  published  three  times  a  year  and  is 
available  to  anyone  requesting  to  be  on  the  laboratory9 s 
mailing  list. 

Policy  Notes   is  a  summary  of   Issues   relevant  to 
.   educational  policy  makers  and  is  published  quarterly. 

b.  Policy  Papers 

School  Finance  Report  is  an  annual  update  of  education 
finance  Issues  in  the  Central  Region  prepared  by  John 
Augenblick  of  Augenbllck,  Van  de-  Walter  and  Associates. 
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Report  on  Education  Trends  is  an  annual  report  on 

national  education  trends  prepared  for  the  Central  Region  by 

Shirley  HcCune  and  McREL  state  policy  staff. 

c.      Training  and  Development  Resources 

Noteworthy  is  an  annual  magazine  that  contains  solid 
practical  information  centered  around  a  specific  theme. 
This  year's  issue  was  on  the  topic  of  restructuring  or 
redesigning  schools.  McREL  disseminates  15 , 000  copies 
to  the  region's  superintendents,  assistant 
superintendents,  curriculum  specialists,  staff 
developers,  and  principals. 

Effective  Leadership  for  Improvement  and  Change; 
Administrator  Training  Materials  is  designed  to  help 
administrators  understand  the  various  leadership  roles 
they  can  or  do  perform  and  how  they  may  increase  their 
overall  effectiveness.    Prepared  by  Shirley  McCune. 

Rural  School  Source  Book  is  a  sample  of  exemplary  programs, 
practices  and  resources  for  rural  educators  compiled  under 
subcontract  by  Dr.  Mary  Jaguar t  and  Dr.  Joe  Newlin  from 
Colorado  State  University,  Fort  Collins,  Colorado. 
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North  Central  Regional  Educational  Laboratory  (NCREL) 


298  Earoy  Avenue 
Hlmhurst,  XL  60126 
312-941-7677 

Jeri  Nowakowskl  ,  Interim  Executive  Director 

Ted  Sanders,  Chair,  Board  of  Directors  (April,  1988  to  March,  1989) 

State  Superintendent  of  Education 

Illinois  State  Board  of  Education 

100  North  First  Street 

Springfield,  IL  62777-0001 

217-782-4321 

Areas  Served:    Illinois,  Indiana,  Iowa,  Michigan,  Minnesota,  Ohio 

and  Wisconsin 

Malor  Activities 

NCREL 's  mission  Is  to  support  school  reform  Initiatives  In  the  seven 
state  region  In  program  areas  that  are  designed  to  1)  Improve 
curriculum  and  Instruction  2)  enhance  the  education  professions  and 
3)  strengthen  school  partnerships.    This  mission  Is  accomplished 
through  the  following  strategies: 

o  Facilitating  Action  R&D  Projects.    This  strategy  focuses  on  the 
lab  9s  collaborative  work  with  a  set  of  partners  to  deliver 
Information  and  services  to  specified  sets  of  clients  In 
designated  schools. 

o  Developing  R&D  Based  Information,    The  strategy  extends  the  lab's 
capabilities  for  carrying  out  action  r&d  projects,  policy  forums, 
and  dissemination  services.    Specific  r&d  efforts  undertaken 
by  the  lab  Include  developing  a  line  of  products  called 
"profiles".    The  profiles  describe  the  results  of  the 
lab's  action  r&d  projects.    Sets  of  profiles  will  describe 
project  specific  activities  such,  as- a-  case  study,  while  other  sets 
will  pressnt  methods,  of  facilitating  project  activities.  Under 
this  strategy,  the  lab  also  engages  In  the  collection  of  papers 
and  reprints  relevant  to  project  activities,  develops  portfolios 
of  Intervention  resources,  develops  policy  briefs,  and  develops 
and  delivers  video- teleconferences. 

o  Conducting  Policy  Forums*    In  this  strategy,  the  lab  convenes 
policy  forums  for  sach  state  In  the  region  focusing  state 
specific  activities.    Regional  policy  forums  addressing  on  Issues 
of  general  Interest  In  all  seven  statss  are  also  conducted  by  the 
lab.    Additionally,  the  lab  supports  regional  policy  networks 
such  as  the  State  Assessment  Network  and  Interacts  with  national 
policy  association  Including  the  Education  Commission  of  the 
States,  when  appropriate. 
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.o  Dissemination  Services.    This  strategy  is  designed  to  Increase  the 
aimrtMM  of  a  large  number  of  educators  In  the  region  about 
rftd  information  resources  available  to  them.    The  r&d  resources 
are  an  outgrowth  of  the  laboratory's  program  areas.  Major 
activities  Include  the  distribution  of  announcements  of 
available  publications,  the  delivery  of  presentations  to  selected 
audiences  and  the  operation  of  a  referral /brokerage  service  for 
speakers,  trainers,  and  consultants. 

o  Rural  and  Small  Schools.     The  primary  focus  of  NCREL's  rural 
education  Initiative  Is  the  Wisconsin  Rural  Reading  Improvement 
Project.    Eighteen  email  rural  districts  In  seven  west-central 
counties  In  Wisconsin  are  engaged  In  a  project  to  improve 
reading  instruction  In  elementary  schools.    Technical  assistance 
and  staff  development  services  are  delivered  through  five 
telecommunications  technologies.    In  the  other  six  states  served 
by  HCRRL,  small  scale  rural  Initiatives  are  designed  to  help 
small,  rural  schools  participate  fully  In  state-initiated 
educational  reforms. 

Major  Accomplishments 

o  Established  an  ongoing  service  of  monthly  ,  training  and  planning 
seminars  for  more  than  100  members  of  the  Prof esrional.  Development 
Leadership  Teams  from  26  high  schools  in  the  Chicago  Public 
School  System. 

c  Planned  and  conducted  a  series  of  teleconferences  designed  to 
provide  high  quality  staff .  development  to  states  and  school 
districts  using  video  capabilities  and  supporting  print  materials. 

o  Conducted  several  regional  conferences  designed  to  provide 
decision  and  policy  makers  with  current  Information  on 

educational  issues.    Such  conferences  Include  the  fir^C  (1987) 
and  second  (1988)  regional  conferences  on  "Eids-at-Risk. n 

o  Conducted  sixteen  invitational  policy  seminars  across  the 
seven  etate  region.    As  a  result  of  the  Minnesota  policy 
seminar,  specific  legislation  to  Implement  a  Professional 
Development  Statue  was  Introduced  and  passed  by  the  State 
legislature  In  1987. 

o  The  Wisconsin  Rural  Reading  Improvement  Project  won  second 
place  for  "Best  Distance  Learning  Program  1988  -  K  through 
12"  at  the  Seventh  Annual  TeleCon  Awards  Program  sponsored  by 
Teleconference  Magazine. 
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Principal  Products 


o  KSWgletterS 

—  "Testing  and  Assessment  Quarterly, "  published  four  times 
•  year  for  approximately  5,000  recipients  Interested  In 
testing  and  assessment  and  Its  relationship  to  school 
Improvement . 

—  "The  Rural  Bd  View,"  published  four  times  a  year  for 
approximately  1,000  recipients  Interested  In  the  education 
of  students  in  rural  and  small  schools  In  the  NCREL  region. 

o  Knowledge  synthesis 

—  Prom  Isolation  to  Collaboration;  Improving  the  Work  Environment 
of  Teaching.  Synthesis  of  Literature.  1987.  Scott  &  Smith. 
Companion  annotated  bibliography:  The  Social  and  Organizational 
Context  of  teaching:  An  Annotated  Bibliography.  1987.  Scott. 

—  Students  at  Risk:  A  Review  of  Conditions.  Circumstances. 
Indicators,  and  Educational  Implications.  1986.  Doss-Willis. 

—  Incentives  that  Enhance  the  Teaching  Profession:  Background 
Paper,  1987.  Bartell. 

—  Proceedings  of  a  Seminar  on  Incentives  that  Enhance  the 
Teaching  Profession:  A  Discussion  of  the  Policy  Issues? 
1987.  Bar veil,  editor. 

—  Describing  Rural  Primary  »  d  Secondary  Education:  The  Rc  . 
of  State  Education  Agency  Information,  1989..  Horned. 

—  Financing  Rural  Education  In  the  North  Central  Radon:  A 
Pilot  Study  in  Illinois.  1989.  Lows. 
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Northwest  Regional  Educational  Laboratory  (NWREL) 

101  S.W.  Main  Street,  Sulta  500 
Portland,  OR  97204 
(603)  275-9500 

Br.  Robert  R.  Rath.  Executive  Director 

Or.  Baxrey  C.  Parker,  Chair,  Board  of  Directors  (Term  Expiree  June,  1989 
Superintendent 

Independent  District  of  Boise 
1207  Fort  Street 
Boise,  ZD  S3702 
308-338-3400 

Arses  Served:  Alaska,  Hawaii,  Idaho,  Oregon,  Montana,  Washington, 

Tsrrltory  of  American  Samba,  Territory  of  Guam, 
Commonwealth  of  the  Northern  Mariana  Islands 


Major  Activities 

NWREL  structures  Its  activities  In  terms  of  ssvsn  long-term  program 
priorities  based  on  asssssmsnt  of  educational  needs  In  the  region.  A 
total  of  about  40  OERI-funded  project  activities  fall  Into  these  seven 
areas.    Most  rsprssent  ths  continuation  or  expansion  of  activities 
initiated  under  prior  contracts  with  0ERI/NIE  or  ths  old  Offlcs  of 
Education,  dating  back  to  ths  establishment  of  ths  laboratory  In  1966. 

o  Asssssmsnt  and  Evaluation.    School  improvement  efforts  have 
placed  increasing  emphasis  on  ths  systematic  msasursmsnt  of 
student  achlevment  and  evaluation  of  the  effectiveness  of 
laprovsmsnt  sf forts.    Activities  in  progrsss  with  respect  to  this 
priority  Include  a  variety  of  evaluation  and  asssssment  projects, 
along  with  reeearch  and  training  activities  carried  out  through 
the  Center  for  Classroom  Asssssmsnt. 

o  Cultural  Understanding  and  Equity.    Ths  Northwest  States  and  the  . 
Pacific  Islands  contain  a  rich  blend  of  cultural  and  ethnic 
groups.    Ths  Pacific  Region  Educational  Program  assists  educators 
in  Hawaii,  the  Territory  of  American  Samoa,  the  Territory  of  Guam, 
the  Commonwealth  of  the  Northern  Mariana  Islands,  Palau,  the 
Republic  of  the  Marshall  Islands,  and  the  Federdated  States  of 
Micronesia  (Including  Koerae,  Pohnpsl,  Truk,  %nd  Yap),  through 
networking,  capacity  building,  and  R&D  to  carjry  out  echool 
Improvement  etrategles.    Both  in  ths  Pacific  aad  ths  Northwest  the 
NWREL  also  opsratss  a  variety  of  non-OERI  funded  programs,  such  as 
the  Center  for  National  Origin,  Race,  and  Sex  Equity. 

Education  Involving  Business  and  Human  Roeource  Agencies.  Schools 
arc  increasingly  sntsrlng  into  nsw  and  crsatlvs  relationships  with 
the  private  eector  in  their  communities.    Ths  NWREL* s  Education 
and  Work'  Program  provldss  a  varlsty  of  rsssarch  and  dsvlsopment 
resources  for  local,  regional,  and  national  policy  and  practice  In 
career  development  and  occupational  training,  with  program 
activity  strands  In  sffsctlvs  vocational  sducatlon,  effective 
programs  for  high  risk  youth,  technological  literacy,  and 
education/private  ssctor  partnerships. 
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o  Prof asslonal  Development .    Development  of  people  Is  central  to  an 
organization's  long-tera  vitality  and  effectiveness.    The  NWREL 
conducts  prograas  for  Improving  the  education  professions  through 
tsachsr  evaluation  for  growth  and  development  and  via  colleglal 
development. 

°  Rural  Education.    Small  rural  schools  have  special  needs  arising 
from  isolation,  slzs,  and  depression  In  the  traditional  rural 
economy.    Through  OERZ'e  Rural  Education  Initiative  the  NWREL 
provides  training  and  technical  assistance  for  Improvement  of 
•mall  rural  schools,  whlls  ths  R&D  Access  for  Rural  Schools 
program  assists  rural  schools  In  Implementing  R&D  based  solutions 
to  their  problems. 

o  School  Improvement.    Student  performance  can  be  Improved  through 
the  consistent  application  of  research  and  development  knowledge 
on  effective  schooling  practlcss.    Ths  NWREL' s  School  Improvement 
Program  works  through  school  Improvsmsnt  organizations  to  assist 
practitioners  in  using  sffsctlvs  schooling  practlcss  and 
goal-based  management  proceeees  to  Improve  student  performance. 

o  Technology.    Advances  In  technology  offer  opportunities  to  better 
serve  all  students,  especially  ths  isolated  and  at-risk.  The 
NWREL 's  Technology  Program  develops  and  dlsssmlnatss  eff active 
applications  of  technology,  conducts  ressarch  on  the  application 
of  technology  to  educational  needs,  evaluates  ths  effectiveness  of 
technological  applications  In  educational  programs,  and  conducts 
training  and  demonstrations  of-  applications  of  tschnology  for 
Instruction  and  administration. 


Major  Accomplishments 

In  1988  NWREL  conducted  training  and  technical  ass stance  activities 
Involving  ovsr  37,000  educators  In  Its  regions.    The  laboratory  produced 
791  different  reports,  publications  and  resource  documents,  including 
"Consumer  Guides"  on  aeeessasnt  toole  in  the  area  of  early  childhood 
education  and  on  assessing  leadership  and  managerial  behavior,  a 
regional  database  of  Information  on  over  1800  dletricts  in  ths  six 
Northwest  States,  a  monthly  neweletter  (The  Northweet  Report) 
distributed  throughout  the  region,  a  report  on  research  and  practice  In 
rural  teacher  preparation  programs,  a  wlds  range  of  policy  analysis 
papers,  a  variety  of  brief  and  extensive  reeearch  synthesis  reports,  and 
a  series  of  rsports  identifying  and  svaluatlng  available  Instructional 
software  packages.    Ordsrs  wsrs  flllsd  In  1988  for  ovsr  12,000  copies  of 
34  NWREL  products. 

Specific  accomplishments  include: 

a  Developing  and  training  "R&D  Cadres"  In  ths  various  Pacific  Basin 
Region  entltlee; 


o  Co-sponsorship  of  ths  annual  Pacific  educators  conference; 
approximately  500  attended  the  1988  conference,  In  Quam; 


Paga  Three 


o  A  regional  conference  on  "Work  Now  and  In  the  Future"  that  drew 
over  600  partlclpante  and  presenters  In  1986; 

o  Establishment  of  the  Northwest  Partnership  Network,  a 

clearinghouse  for  promising  practices  on  business-education 
alliances; 

o  Development  of  a  regional  database  with  Information  on  over  1800 
districts  In  the  elx  Northwest  States; 

o  Maintenance  of  the  Northwest /Pacific  Regional  News  on  ED-LINE; 

o  Expansion  of  the  Rural  Education  Consortia-Network,  to  include  13 
agenclee  In  the  regions,  working  cooperatively  to  address  the 
needs  of  email  schools; 

o  Co- sponsorship  of  Stats  tsachsr  evaluation  conferences  (In  Idaho 
and  Montana  in  1988),  and  sponsorship  of  the  Annual  Northwest 
Teacher  Evaluation  Conference; 

o  "Onward  to  Excellence"  school  Improvement  leadership  team  training 
and  technical  assistance  was  provided  to  over  400  schools; 

o  The  RICE  database  was  converted  from  a  mainframe  databass  system 
to  a  microcomputer  and  made  available  In  an  offline  mode. 


Principal  Products 
o  Newsletters 

—"Northwest  Report"  is  published  monthly,  with  special  sections 
dsvotsd  to  Urban  Education,  rural  Education,  Pacific  Education, 
Indian  Education,  and  Education  Policy  Makers. 

Consumers  Guides 

— "Assessing  Leadership  and  Managerial  Behavior" 
— "Assessing  Learning  Motivation" 
—"Assessing  School  and  Classroom  Cllmats" 
Publications  and  Reports 

—Planning  for  Computers  in  Education  Handbook 

—"Summary  of  Rssearch  on  Class  Size" 

— "Close-Up:  Parent  Involvement  in  Education" 

— "Software  for  Substance  Abuse  Education:  A  Critical  Revlsw  of 
Products" 


*age  soar 

— "Tuchtr  Training  In  Classroom  Assessment:  Exploring  the  Impact" 
— "Strategies  for  Developing  Sound  Grading  Practices" 
— Mentor  Teacher  Handbook 
—Profile  of  Pacific  Schools 

— "Distance  Education:  An  Overview"  (ED  278  519) 
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jgolonal  Laboratory  for  Educational  Improvement  of  the  Northeast 

and  Islands  (WE/ ID 
290  South  Main  Street1 
fcndover,  Massachusetts  01810 
hone:     (508)  470-0098 

Executive  Director:    Or.  David  P.  Crandall 

Board  Chair:    Margaret ta  Edwards  (term  expires  September  29,  1989) 
Assistant  Director 

Rhode  Island  Small  Business  Development  Center 
Providence,  Rhode  Island 

Areas  served:    Men  York,  New  Hampshire,  Rhode  Island,  Vermont, 

Connecticut,  Massachusetts,  Maine,  Puerto  Rico, 
and  Virgin  Islands 

lialor  Activities 

Teacher  Development,  Including  the  dissemination  of  strategies 
for  Improving  teacher  effectiveness,  efforts  to  expand  the 
role  of  teacher  mentors,  and  a  major  effort  to  develop 
Instructional  approaches  for  Introducing  thinking  skills 
into  the  curriculum. 

Public  Policy.  Including  both  dissemination  and  technical 
assistance  to  state-level  policy  makers  and  assistance  for 
a  "common  market"  study  of  teacher  supply  and  demand  In  the 
Northeastern  States. 

At-Rlsk  Youth.  Including  the  preparation  of  guidebooks  and 
direct,  technical  assistance  , to  model  schools  In  each  state 
and  jurisdiction  In  the  region. 

o     Rural  and  Small  Schools  network  across  the  region;  and 

o     State  Specific  activities,  which  provide  services  tailored 
to  unique  priorities  of  each  State. 

Ha  lor  Accomplishments 

Development  and  Dissemination  of  Products.    The  products  listed  on 
page  3  embody  much  of  the  work  performed  by  the  laboratory  and 
represent  key  accomplishments,  usually  achieved  In  partnership 
with,  or  as  a  service  requested  by,  practitioners,  service 
organisations,  or  educational  leadere  In  the  region.    In  their 
development  and  in  their  dissemination  those  products  have  eerved 
as  foci  of  most  of  the  lab's  program  activities  to  date.  Other 
imilar  products  are  still  at  various  stages  of  development  and 
some  Items,  such  as  Issue  analyses  and  concept  papers  prepared  for 
various  policy  clienteles,  are  not  shown  as  major  products. 

r,  BEST  COPY  AVAILABLE 
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Const Itutent  Strvlcts — Planning  and  Technical  Assistance, 
Substantial  effort  during  years  1-3  went  Into  establishing 
collaborative  relationships  with  specific  clientele  groups  and 
organizations  Involved  In  Improving  education  In  the  region.  This 
involved  creating  awareness  of  what  the  lab  had  to  offer, 
providing  technical  assistance,  and  developing  £olnt  activities, 
as  well  as  disseminating  products. 

Sons  accoapllshnents  of  this  type  were: 

o     Developed  and  convened  a  regional  network  of  agencies  that 
provide  training  for  school  principals.  Supported 
dissemination  and  training  for  use  of  the  Far  Meet 
Laboratory's  Peer  Assisted  Leadership  model  to  strengthen 
performance  of  principals.    Created  and  disseminated  four 
Issues  for  a  principals1  newsletter,  tmwimm  Leaders. 


Supported  the  Teacher  Change  Vetwork,  a  group  of  school 
district  leaders  Interested  In  research-lnto-practlce 
Issues,  and  assisted  the  Connecticut  SEA  In  establishing  a 
mentor  teacher  program. 


Conducted  forums  and  roundtable  discussions  for  state 
legislators  and  SEA  leaders  on  Issues  In  teacher  supply  and 
demand,  at -risk-youth,  curriculum,  and  use  of  technology. 
Obtained  joint  sponsorship  for  such  work  from  Education 
Commission    of  the  States,  Danforth  Foundation,  Boston 
University,  and  others. 

Conducted  regional  and  state  conferences  on  specifying 
approaches  to  problems  of  At -Risk  Youth. 


o     Prepared  a  reference  guide  of  groups  in  the  region  ualng 
various  approaches  to  reform  In  teacher  education. 

Principal  Products 

o  newsletters 

-  The  Cutting  Edge:  New  R&D  Products  (monthly,  except 
December    and  July) 

-  Rural/Small  Schools  bl -monthly  newsletter.  Alert,  and 
exchange  packets  of  school  practice  material  disseminated 
to  480  districts  and  30  organizations  In  Small  School 
Vetwork. 

o     Business-Education  Partnerships:  Strategies  for  School 
Improvement 

o      Implsmentatlng  the  Re*-™wm»n^atlons  of  "Becoming  a  Nation  of 
Readers":  A  Guide  for  Practitioners 
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o      A  Directory  of  Research-Based  Tools  for  Implementing  School 
Improvement  Plans 

o     Leadership  and  Support  for  School  Improvement 

o      Continuing  to  Learn;  A  Guidebook  for  Teacher  Development 
(Published  In  collaboration  with  the  National  Staff 
Development  Council . ) 

o     Teaching  Thinking  Skills  (The  first  of  a  10- unit  thinking 
skills  program  being  developed  with  David  Perkins  to  Infuse 
of  thinking  skills  across  the  curriculum. ) 


ERIC 


Teacher  Quality  In  Puerto  Rico  (Pre:»ared  for  Puerto  Rico 
Department  of  Education. ) 
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Laboratory:  Research  for  Better  Schools 
444  North  Third  Street 
Philadelphia,  Pennsylvania  19123-4107 
Phone:  215  574-9300 

Executive  Director:  John  E.  Hopkins 

Chair.  Board  of'  Directors:  Robert  C.  Carlson,  July  1988- June  1989 

Executive  Assistant  to  the  Superintendent 

District  of  Columbia  Public  Schools 

Presidential  Building 

415  12  Street,  NW 

Washington,  D.C.  20004 

Phone:  202  724-4222 

Areas  Served:  Delaware,  District  of  Columbia,  Maryland,  New 
Jersey  and  Pennsylvania 

Major  Activities 

.     Cooperative  School  Improvement.    This  program  works  with  five 
regional  networks,  including  (1)  the  Mid-Atlantic  Metropolitan 
Council,  composed  of  Superintendents  of  Baltimore,  District  of 
Columbia,  Newark,  Philadelphia  and  Pittsburgh  public  schools  (2) 
the  Urban  Superintendents  of  New  Jersey  (3)  the  Intermediate 
Units  of  Pennsylvania  (4)  the  Maryland  Assistant  Superintendents' 
Council  and  (5)  the  Rural  and  Small  Schools  Exchange  on  projects 
focussing  on  four  content  areas:  thinking  skills,  organizational 
development,  secondary  school  improvement  and  beginning  teacher 
induction . 

State  Leadership  Assistance.  This  program  provides  assistance 
to  state  level  decisionmakers  and  state  education  agencies  in 
five  areas:  basic  ski lis -achievement;,  curriculum,  instruction  and 
the  use  of  technology;  the  quality  of  teaching;  the  effectiveness 
of  schools  at  all  levels;  and  education  for  at  risk  students;  and 
also  assists  state  decisionmakers  explore  developing  issues 
through  planning  and  organizing  meetings  on  topics  of  interest  to 
them. 

•    Applied  Research.    This  project  conducts  research  of  two 
kinds:  (1)  improvement  studies  which  are  focussed  on  issues  of 
broad  regional  and  national  lntereet  using  data  drawn  from 
various  educational  organizations  in  the  region,  including  SEAs, 
districts,  schools  and  classrooms;  and  (2)  policy  studies  which 
are  tailored  to  the  needs  of  specific  regional  clients. 

.    Special  Populations.    This  project  has  two  foci:  (1)  to 
Increase  awareness  of  the  needs  of  low-achieving  youth,  and  (2) 
to  develop  a  model  to  help. educators  lncreaee  their  skills  and 
ability  to  implement  improvement  processee  for  low-achieving 
youth,  primarily  those  located  in  suburban  and  rural  settings. 
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.    Rural  and  Small  Schools  Project.    This  project  is  (1) 
providing  continuing  assistance  and  evaluation  of  progress  and 
outcomes  at  three  sites  where  a  computer-managed  instruction 
program  has  been  implemented,  and  (2)  assisting  three  RBS- 
created  state-level  Rural  Assistance  Councils  In  Delaware, 
Pennsylvania  and  New  Jersey  develop  statewide  plans  for 
improving  rural'  education. 


Major  Accomplishments 

.  Assisted  the  Pennsylvania  Department  of  Education  modify  Its 
Chapter  I  monitoring  process  for  300  schools  to  include  factors 
related  to  student  basic  skills  achievement. 

.    Provided  support  to  the  Maryland  State  Department  of  Education 
In  the  establishment  and  operation  of  a  commission  on  students  at 
risk  which  assists  local  communities  and  schools  address  the 
problems  of  students  at  risk. 

.    Created  and  maintained  an  active  urban  network  comprised  of 
superintendents  of  the  five  largest  districts  in  the  region 
(Baltimore,  District  of  Columbia,  Newark,  Phlladephla  and 
Pittsburgh)  under  whose  auspices  projects  in  the  area  of  thinking 
skills  and  secondary  school  Improvement  have  been  Implemented  in 
each  district. 

Completed  a  two  year  study  of  statewide  testing  programs  for 
Maryland  and  Pennsylvania  which  compared  the  local  effects  of  the 
testing  programs;  and  disseminated  study  findings  to  state - 
policymakers,  local  educators  and  at  national  conferences. 

.    Designed  a  study  of  the  role-  of  the  central  office  in  school 
improvement  that  is  using  as  study-  sites  seven  districts  In  New 
Jersey  and  Pennsylvania  with  a  reputation  for  strong  central 
office  Involvement  in  school  improvement . • 

Provided  leadership  to  a  collaborative  effort  among  the  nine 
regional  laboratories  which  focusses  on  the  teaching  of  thinking 
skills;  and  which  resulted  In  a  number  of  joint  products,  a 
newsletter,  and  a  seminar  for  OERI  and  Washington-based  education 
association  staff  in  which  the  work  of  the  collaborative  was 
presented. 

.    Assisted  the  New  Jersey  Department  of  Education  in  the 
planning  and  development  of  the  Beginning  Teacher  Induction 
Center  in  Glassboro,  New  Jersey. 
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.    Planned  and  conducted  a  three  day  retreat  for  42  SEA  managers 
working  on  school  Improvement  from  Delaware,  Maryland,  New  Jersey 
and  Pennsylvania  which  explored  the  role  of  the  SEA  In  local 
educational  practice. 

.    Designed  and  Implemented,  In  collaboration  with  the  Maryland 
Department  of  Education,  a  study  of  the  Maryland  High  School 
Graduation  Requirements . 

.     Assisted  the  Technical  Assistance  Center  at  Coppln  State 
College  in  Baltimore  Incorporate  a  teaching  of  thinking  skills 
for  svudents  at  risk,  component  In  Its  teacher  education  program. 

.     Created  a  network  of  502  rural  educators  and  facilitated  the 
exchange  of  Information  among  this  network. 

Created  rural  assistance  councils  for  the  states  of  Delaware, 
New  Jersey,  and  Pennsylvania  which  are  developing  statewide  plans 
and  guidelines  for  Improving  rural  education  In  those  states. 


Principal  Products 
Knowledge  Synthesis; 

.     Critical  Thinking  and  Thinkinj  Skills:    State  of  the  Art 
Definitions  and  Practice  In  Public  Schools.    Barbara  Z. 
Presselsen.  1986.. 

Looking  at  Schools:     Instruments  and  Processes  for  School 
Analysis.    Janet  McGrall  et  al.  1987. 

.     Places  Where  Children  Succeed:    A  Profile  of  Outstanding 
Elementary  Schools.    Bruce  L.  Wilson  and  Thomas  B.  Corcoran. 
1987. 

Policy  Papers: 

.    Secondary  Schools  and  Central  Office:    Partners  for 
Improvement  (Design  and  Final  Report).    Rlma  Miller  et  al.  1987 

The  Coordination  of  Education  and  Social  Services  for  At-rRisk 
Students:    Early  Intervention,  Substance  Abuse,  and  Teen 
Pregnancy  Programs.    William  Firestone  and  Dale  H.  Drewes.  1987. 
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Tralnlnq  and  Development  Resources: 


.    A  Catalog  of  Programs  for  Teaching  Thinking.    Janet  Kruse  and 
Barbara  Z.  Presselsen.  1986. 

.     Classroom  Activities  In  Thinking  Skills.    Janet  Kruse.  1987. 

How  to  Develop  Your  School's  Readiness  for  Improvement:  An 
Analysis  Process  and  Recommendations.     Joseph  J.  D'Amlco  and  K. 
Dickson  Corbett.  1987. 

.    Team  Planning  for  Educational  Leaders:    A  Training  Handbook. 
Rlma  Miller.  1987. 

Specialized  Products: 

Directory  of  Regional  Educational  Resource  Organizations:  The 
Mid-Atlantic  Region.    Peter  J.  Donohoe.  1987. 

.    Trends  In  School  Improvement:    Regional  Test  Results  1984- 
1987.    Thomas  W.  Blester  and  Joan  L.  Buttre  1967. 
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1..  '  Laboratory: 


Southeastern  Educational  Improvement  Laboratory  (SSIL) 

P.O.  Box  12748 

200  Park*  Suite  200 

Research  Triangle  Park,  North  Carolina  27709-2748 
Phone:     (919)  549-8216 

Executive  Director: 

Charles  J.  Law,  Jr. 

Chair.  Board  of  Directors.  December  1967  to  November  1989 

Dr.  Richard  A.  Boyd 

State  Superintendent  of  Education 

Mississippi  Department  of  Education 

Post  Office  Box  771 

Jackson,  Mississippi  39205 

Phone:     (601)  359-3513 

Areas  Served:    Alabama,  Florida,  Georgia,  Mississippi, 

North  Carolina,  South  Carolina 

2.    Major  Activities; 

Major  activities  of  the  Southeastern  Educational  Improvement 
Laboratory  are  organized  under  the  following  programs: 

o        Improving  Instruction  in  Mathematics.    The  primary 
focus  of  this  program  is  to  provide  activities  and 
services  to  K-12  mathematics  teachers  and  supervisors 
on  alternative  ways  to  improve  mathematics  instruction, 
particularly  for  low-achieving  students,    among  the 
major  program  components  are  minority  recruitment  and 
career  awareness,  mathematics  remediation  strategies, 
and  higher  order  mathematics  thinking  skills.  A 
secondary  focus  is  providing  mathematics  in-service 
activities  for  parents. 

o        Improving  Instruction  in  Writing.    This  program  builds 
and  strengthens  networks  among  State  education  agencies 
and  the  Southeastern  Writing  Project  sites.    A  key 
objective  is  to  increase  the  participation  of  teachers 
and  administrators  of  at-risk  students  in  writing 
improvement  activities.    There  is  a  project  to  develop 
and  test  training  materials  for  administrators  in 
fostering  high  quality  writing  programs  in  their 
schools  and  districts. 
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o      Improving  Leadership  Skills,    This  program  works  with 
the  leadership/management  centers  in  each  State 
•ducat ion  agency  and  the  Project  LEAD  centers  to  develop 
the  leadership  skills  of  educators.    Program  components 
include  training  administrators  through  the  use  of  a  set 
of  materials,  Competences  for  Hloh  Performing 
Principals:,  disseminating  information  about  successful 
approachs  to  training  and  placing  minority  and  female 
^administrators;  and  supporting  staff  development 
activities  for  school  leaders  that  provide  them  with  the 
skills  needed  for  responding  to  changing  needs  of 
educators  and  students. 

o      State  Policy  and  Educational  Reform,    Primary  activities 
include  the  provision  of  on-demand  policy  analyses, 
mapping  and  tracking  educational  refprm  activities,  and 
conducting  policy  forums  for  State  legislators  and  their 
legislative  aides.  State  Board  of  Education  members, 
Governors1  education  aides ,  and  high-level  SEA 
personnel.      Eleven  policy  papers  for  educational 
policymakers  are  under  development. 

o       The  Teaching  Profession.    This  program  sponsors  research 
in  the  teacher  labor  market  in  the  Southeast,  such  as  an 
annual  Wage  Comparability  Study  comparing  the  earnings 
of  teachers  with  other  college-educated  workers  in  the 
six-State  region.  A  key  activity  is  attempting  to 
increase  the  jwcessful  recruiting  of  minorities  into  the 
teaching  profession  in  the  Southeast.    The  program  also 
publishes  reports  on  teacher  recruitment,-  retention  and 
prof ess ionalizat ion. 

o        Dropout  Prevention.    The  activities  of  this  program  are 
designed  wo  address  the  problems*  of  students 
likely  to  leave  school  before- graduation.  The 
objectives  are  to  identify  effective  dropout  prevention 
programs,  inform  practitioners  about  these  programs  and 
about  other  resources,  and  to  identify  issues  needing 
further  research.    A  key  activity  is  pilot-testing 
methods  to  encourage  and  assist  adoption  of  successful 
dropout  prevention  programs. 

o       Making  More  Effective  Use  of  Technology.  Major 
activities  include  refining  and  implementing  the 
Software  Evaluation  Exchange  Dissemination  (SEED) 
project,  identifying  effective  instructional  practices 
that  feature  the  use  of  technology,  and  informing 
educators  in  the  region  about  primary  technology 
programs  through  State  and  regional  conferences. 
Project  SEED  is  a  partnership  of  State  education 
agencies  to  train  local  tsachers  to  evaluate 
instructional  software  and  to  disseminate  these 
software  evaluations  to  schools  throughout  the 
q  region. 


o       Rural  and  Small  Schools.    Now  In  its  second  phase,  this 
program  identifies  promising  practices  in  rural 
education;  disseminates  information  about  these 
practices  to  rural,  small  schools  and  others:  works  with 
two  rural,  small  schools  in  each  of  sax  States  in  the 
region  to  help  them  attack  persistent  rural  education 
problems,  and  helps  these  schools  provide  technical 
assistance  to  additional  sites;  and  supports  the 
development  of  School-based  enterprise  projects.  In 
addition,  the  program  generates  information  about  rural 
education  in  the  region  and  is  developing  a  data  base  on 
rural,  small  schools  that  will  lead  to  a  profile  of 
rural  education  in  each  State. 

Major  Accompl ishments : 

o       This  new  laboratory  has  developed  a  sound  governance 
structure,  developed  strong  ties  with  major 
constituencies  in  the  region,  and  is  becoming  more 
effective  and  successful  in  providing  its  clients  with 
an  array  of  services. 

o       An  external  evaluation  of  SEIL  activities  for  1986  and 
1987  found  that,  "In  only  two  years  of  existence,  SEIL 
seems  to  have  done  a  good  job  of  making  Itself  generally 
known  in  the  region." 

o       In  the  first  year  of  its  existence,  SEIL  disseminated 
4303  copies  of  its  R&D  products,  while  in  the  second 
year  34,789  copies  of  SEIL  R&D  prcducts  uere 
disseminated . 

o       To  date,  546  evaluators  have  been  trained  under  Project 
SEED,  597  instructional  software  programs  have  been 
evaluated,  and  information  about  these  evaluations 
distributed  widely  throughout  the  six-State  area. 

o       A  tracer  ,tudy  of  the  effects  of  selected  SEIL 

activities  concluded  that,  "The  service  component  of 
both  the  SEED  project  and  the  effective  V  thematics 
Teaching  workshops  were  well  received  in   .erms  of  their 
relevance,  comprehensiveness  (especially  for 
mathematics)  and  clarity.    Both  were  found  -Lo  be  useful 
by  those  who  participated." 


The  North  Carolina  Public  School  Forum's  Study  Group, 
comprised  of  Forum  board  members  and  business  leaders, 
used  the  1987  update  of  the  SEIL  wage  comparability 
study  to  formulate  recommendations  on  teacher  salaries 
that  were  shared  with  the  General  Assembly  and  State 
Board  of  Education.    The  Forum's  executive  director 
reported  that  the  salary  subcommittee ' s  focus  shifted 
from  increasing  beginning  teacher  salaries  to  Improving 
career  earnings  of  experienced  teacher  as  a  direct 
result  of  the  report. 

The  rural  education  program  has  progressed  to  the  point 
where  it  pulled  together  information  from  18  local 
school  districts  t?  document  activities  for 
dissemination .    The  first  product  for  disssemlnation 
highlighted  parental  involvement  in  rural  schools. 

The  first  of  what  will  be  annual  regional  conferences 
was  held  December  6-8,  1988  In  Orlando,  Florida. 
Focused  on  the  theme  "Building  Educational  Success  for 
All  Our  Kids,"  the  event  attracted  over  125  educators 
from  the  Southeast.    Without  exception,  evaluations 
received!  were  enthusiastic  and  indicated  that  those  in 
attendance  would  both  attend  a  similar  conference  in  the 
future  and  encourage  others  to  attend  it. 
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4l    Principal  Products: 

a.  Newsletters: 

o  The  Kev,  six  issues  per  year;  contains  descriptions 
of  products  developed  by  laboratories,  R&D  centers* 
and  others  supported  by  OERI,  which  are  distributed 
widely  to  practitioners  and  policy  makers. 

b.  .Knowledge  Syntheses: 

o  Improving  the  Second  "R" :  Writing  Projects  on  Staff 
Development,  Carole  Capper  and  Naida  Bagenstos,  May 
1987. 

o  NTeacher  Fringe  Benefits  in  the  Southeast ,"  Program 
on  the  Teaching  Profession,  1988. 

o     .  Programs  for  Preparing  Minorities  and  Women  in 
Educational  Administration,  Sandra  Tpnnsen,  and 
others,  1988. 

c.  Policy  Papers: 

o       Dimensions  of  Public  Support  for  Financing 

Education  Reform  in  the  Southeast,  /rank  Howell, 
December  1988. 

o       A  Summary  of  AIDS  Educational  Policies  in  Six 

Southeastern  States,  Stephen  Peters,  April  1988. 

d.  Training  and  Development  Resources: 

o       Effective  Mathematics  Teaching:  Remediation 

Strategies,  Grades  K-5,  Gypsy  Abbott  at .al . ,  1987. 

o       Competencies  for  High-Performing  Principals ,  a  set 
of  ten  training  modules  by  various  scholars  ,  1987. 

e.  Specialized  Products: 

o       An  Analysis  of  the  Comparability  of  Teacher 

Salaries  to  the  Earnings  of  Other  College  Graduates 
in  the  Southeast:  1987  Update,  Ronald  Bird,  1988. 

o       Telecommunications  -  Based  Distance  Learning:  a 
Guide  for  Local  Educators,  Sally  Bond,  1987. 

o  Improving  Mathematics  Curriculum  and  Instruction:  a 
South  Carolina  Model  for  Using  Statewide  Test  Data. 
Joseph  Ryan,  1988. 
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Southwest  Educational  Development  Laboratory  (SEDL) 


Austin,  Texas 


Preston  C.  Eronkosky,  Executive  Director 

Pat  Crist,  Board  Chairperson,  State  Capitol  Bldg.  Oklahoma 
FY  1989  Funding:  $1,423,041.00 

Areas  Served:    Arkansas,  Louisiana,  New  Mexico*  Oklahoma,  and 

Texas  , 

Ma 1or  Activities 

SEDL's  regional  laboratory  service  strategy  Is  to  address  Issues 
Identified  by  educators.  Intermediaries*  and  decisionmakers  as 
current  and  significant  areas  of  need.    Based  on  continual  needs 
sensing  and  evaluation  activities,  SEDL's  Beard  of  Directors 
selects  and  annually  recommits  the  organization  to  work  on 
groups  of  programmatic  themes  under  Its  regional  educational 
laboratory  contract.    During  1989-1990,  these  themes  Include: 

o      Improving  Teacher  and  Administrator  Performance 

o      Improving  School  and  Classroom  Productivity 

o     Facilitating  Student  Achievement  In  Reading,  Writing,  and 
Critical  Thinking  Skills 

o      Information  Services  for  Educational  Decisionmakers  and 
Regional  Partners 

In  addition  SEDL  Is  wording  to  Improve  staff  development 
delivery  systems  for  r  small  schools  under  a  special  Rural, 

Small  Schools  Inltlatl 

Major  Accomplishments 

o     In  August  of  1989  t»EDL  held  a  major  regional  conference 

centered  around  the  publication,  Organizing  for  Excellence, 
a  systhesls  report  on  effective  teaching  and 
administration.    The  report,  prepared  by  SEDL  staff, 
proposes  the  development  of  a  research  based  administrative 
traiajLog  model  which  many  of  the  regional  conference 
participants  agreed  to  utilize  as  a  central  framework  for 
the  home  grown  models  they  would  develop. 

o     Through  Its  continued  provision  of  valuable  information  to 
state  legislators,  state  education  department  officials,  and 
their  staffs,  SEDL's  ED  AIDE  team  has  been  able  to  have  a 
regional  Influence  on  decision  Making  and  programming  In 
such  areas  as  youth-at-risk,  options  for  language 
assessment,  effect  of  class  size  on  merit  pay,  distance 
learning  and  economic  development.    The  team's  rapid 
response  service  assures  Its  clients  of  receiving  the 
latest,  most  up  to  date  Information  on  a  variety  of  topics 
In  a  timely,  facllltative  manner. 
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o      SEDL  has  established  a  demonstration  school  program  wherein  5 
schools,  one  per  state,  which  are  resource  hound  and  serving 
low  Incoae  children,  are  receiving  an  Intensive  program  ol; 
school  laproveaent  assistance.    The  assistance  Is  provided 
▼*»  *  teaa  approach  coaprlsed  of  representatives  of  fZAs, 
LZAs,  local  universities  and  business  and  community 
organizations.    The  learning  to  emerge  from  these 
demonstration  sites  will  be  used  to  develop  assistance  and 
training  of  facilitators  for  other  school  Improvement 
'forts. 

o     SZDL  has  been  providing  resources  and  assistance  to  the  five 
LEAD  programs  In  Its  region.  Including  the  preparation  of  a 
comprehensive  synthesis  of  competencies  associated  with  the 
administration  of  effective  schools  entitled  "Dimensions  of 
Effective  Leadership"  and  a  directory  describing  resources 
for  administrator  assessment  and  staff  development.  The 
"Dimensions"  report  has  been  disseminated  to  all  51  LEAD 
programs  throughout  the  country. 

o      Because  SEDL  was  so  successful  In  training  the  20  directors 
of  the  Texas  Intermediary  Service  Units  In  school  Improvement 
techniques,  the  lab  was  called  upon  to  train  the  Texas 
Education  Agency's  Accreditation  Division:    the  division  In 
turn  trained  many  principals  and  other  administrators  from 
all  over  the  state. 

o      Under  Its  Rural,  Small  School  Initiative,  SZDL,  working 

through  30  strategically  located  elementary  schools,  trained 
scores  of  trainers  and  other  partners  In  strategies  and 
techniques  designed  to  Improve  rural,  small  schools.  The 
training  techniques,  materials,  and  processes  developed  by 
SEDL  will  be  utilized  by  SEAs  and  LEAs  In  the  seven  state 
region  for  training  additional  Intermediaries  who  will  work 
with  an  ever  widening  cycle  of  rural,  small  schools  in  the 
Southwest  area. 

Principal  Products 

"Insights  on  Educational  Policy  and  Practice",  this  will  be  a 
series  of  six  papers  (one  per  month  running  from  March  to  October 
of  1989)  based  on  the  latest  research  on  a  number  of  selected 
policy  issues. 

"Investigating  Alternatives:    Nays  of  organizing  Educational 
Systems",  a  series  of  four  resource  papers  to  oe  used  in  the 
delivery  of  training  and" technical  assistance  and  for 
dissemination  to  state  level  policy  and  decision  and  makers  and 
LEAD  centers  In  the  SEDL  region. 

"Review  of  Literature  on  the  Role  of  the  Superintendent", 
expected  publication  date,  June,  1989. 
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"Gaining  Entry  and  Bonding  with  Snail  Rural  Schools",  a 
specialized  article  due  out  In  November  of  1989. 

Conditions  and  Needs  of  Rural,  Small  Schools  In  the  Southwestern 
Region" .  Sept.,  1989. 

"Critical  Issues  In  Student  Achievement",  this  will  be  a  series, 
updated  periodically,  which  discusses  factors  and  conditions  that 
facilitate  student  achievement  through  reeding,  writing  and 
thinking.    Due  In  May  and  November  of  1989. 

"Facilitating  Student  Achievement:    Focusing  on  Promising  and 
Exemplary  Programs  in  Reading;  Writing;  Partnership; 
Technology".    Due  out  Summer  of  1989. 

"Insights  on  Policy  and  Practice",  this  will  be  a  series  of 
papers  directed  to  state  level  policy  makers  and  decision  makers. 

"A  Review  of  the  Literature  on  the  Relationship  Between  School 
District  Size,  Student  Spending,  and  Student  Achievement',  this 
will  be  a  series  running  over  1989-90.    The  first  paper  will  be 
due  In  July  of  1989. 
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Invitees 

Alan  E.  Farstrup,  International  Reading  Association 
Ronald  Field,  National  Conference  of  State  Legislatures 
Anne  Henderson,  National  Committee  for  Citizens  in  Education 
Rich  Long,  International  Reading  Association 
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Laurence  Peters,  Subcommittee  on  Select  Education  of  the  House 

Education  and  Labor  Committee,    U.S.  Congress 
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Harris  Keller,  Office  of  Elementary  and  Secondary  Education, 
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Education 
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INTRODUCTION 

The  Office  of  Educational  Research  and  Improvement  (OERI) 
of  the  U.S.  Department  of  Education  will  issue  a  solicitation 
early  in  1990  for  proposals  to  operate  regional  laboratories  in 
the  funding  period  beginning  December  1,  1990.    As  part  of  its 
preparation  for  the  recompetition,  OERI  has  sought  views  and 
advice  from  the  field  regarding  educational  needs  and  problems 
in  the  United  states  and  how  the  regional  laboratories  can  help 
respond  to  them.    To  that  end,  OERI  conducted  five  open  meetings 
in  June-July  1989,  including  two  with  invited  representatives 
from  major  educational  associations  and  other  organizations.  The 
other  three  meetings  were  structured  for  public  input. 

Participants  in  the  invitational  meetings  held  June  26  and 
June  27  at  OERI  offices  in  Washington,  D.C. ,  were  invited  to  make 
statements  about  the  laboratories  reflecting  the  views  of  their 
various  constituencies.    They  were  also  asked  to  provide  comments 
and  suggestions  regarding  four  broad  issues: 

•  What  activities  conducted  by  regional  educational 
laboratories  have  been  most  valuable  to  your  constituency 
in  the  past  2-3  years? 

•  What  are  the  key  educational  issues  laboratories  should 
focus  on  in  the  future? 

•  What  kinds  of  activities  and  strategies  (e.g.,  syntheses 
and  other  research  and  development  products,  direct 
technical  assistance,  capacity  building,  etc.)  would  most 
benefit  your  constituency  in  the  future? 

•  What  form  of  laboratory  relationship^? )  with  your 
constituency  (e.g.,  centralized  vs  decentralized,  formal  vs 
informal,  partnerships  vs  contractual)  would  be  most 
effective  in  the  future? 

The  meetings  were  co-chaired  by  Nelson  Smith  and  Charles 
Stalford  of  OERI.  They  noted  that  the  purpose  of  the  meetings 
was  not  to  reach  consensus  but  rather  to  hear  individual  views 
from  different  educational  constituencies.  Stalford  said  that 
OERI  would  consider  every  participant's  comments,  but  should  not 
be  seen  as  endorsing  any  particular  point  of  view  expressed  at 
the  meetings. 

This  report  is  drawn  from  the  reporter's  notes  and  the 
official  transcript  of  the  proceedings.    It  includes  summaries  of 
statements  made  by  individual  participants  and  the  discussions 
around  thosj  statements.    It  also  includes  summaries  of  comments 
on  other  issues  that  emerged  during  the  general  discussions.  In 
instances  where  comments  are  not  attributed  to  an  individual 


participant,  the  statements  are  syntheses  of  comments  made  by 
one  or  more  participants. 

MONDAY,  JUNE  26 

Several  themes  emerged  from  the  individual  participants' 
statements  and  comments  by  other  participants: 

1.  Ways  in  which  the  labs  can  work  most  effectively  with 
professional  associations,  including  strengths  and 
weaknesses  of  the  labs'  indirect  service  strategy  for 
this  purpose. 

2.  The  general  adequacy  of  the  regional  concept  of 
service  at  present. 

•  The  need  for  labs  to  respond  to  individual  state 
needs  as  well  as  regional  needs. 

•  The  extent  to  which  current  educational  problems 
are  regional  in  nature. 

3.  The  need  to  have  a  grassroots-driven  lab  system  that 
could  provide  short-term,  decision-oriented  research 
in  response  to  educators'  immediate  needs. 

4.  What  is  needed  to  make  research  useful  in  classrooms. 

•  Putting  research  in  a  form  teachers  can  understand 
and  providing  them  assistance  in  using  it. 

Alan  E,  Farstrup,  International  Reading  Association  flRA^r 
For  the  most  part,  this  constituency  ^oes  not  have  a  high  level 
of  awareness  regarding  the  work  of  the  laboratories.    The  IRA  has 
had  a  close  relationship  with  the  (research)  center  involved  in 
the  study  of  reading,  and  has  also  worked  with  the  center 
studying  writing  and  literature.    The  IRA  receives  the  centers' 
reports  and  provides  input  on  the  materials  related  to  these 
fields.    Their  relationship  with  the  ERIC  centers  also  involves 
working  together  to  develop  publications,  including  both 
technical  reports  and  syntheses. 

The  IRA's  relationship  with  the  centers  points  to  its 
desire  for  more  direct  relationships  with  the  labs.    The  notion 
of  leverage  incorporated  in  the  lab  indirect  service  strategy 
(of  working  with  and  through  intermediary  organizations  such  as 
state  education  agencies  towards  school  improvement)  is 
acceptable,  but  the  strategy  has  not  worked  up  to  now.  In 
previous  years,  the  labs'  "Research  Within  Reach19  program  was  a 
successful  model  of  cooperative  work.    The  IRA  members  want  to 
be  involvod  in  selecting  subject  matter  for  dissemination, 
rather  than  having  the  "truth  handed  down  from  on  high." 


There  is  a  wide  spectrum  of  subject  matter  groups  and 
professional  groups  who  can  tap  into  the  labs'  work  in  different 
ways.    Their  needs  are  not  regional;  they  vary  with  the  topic. 
For  example,  a  major  issue  currently  is  student-centered  vs 
curriculum-centered  instruction,  or  a  holistic  approach  based  on 
the  child's  needs  vs  :he  approach  which  teaches  a  prescribed 
hierarchy  of  skills.    This  issue  is  bubbling  through  several 
subject  matter  areas,  including  reading,  and  positions  are  being 
taken  based  on  very  little  evidence.    Labs  working  in  this  area 
would  be  particularly  useful  to  the  various  groups. 

Ramsav  Selden,  Council  of  Chief  State  School  Officers 
(CCSSO) !    In  some  regions,  the  lab  is  well-known  and 
appreciated,  while  iu  others,  it  is  not  perceived  as  beinc 
useful.    This  regional  variation  hinges  on  the  degree  to  which 
the  lab  meets  the  states'  specific  needs.    The  labs'  usefulness 
is  further  complicated  by  the  fact  that  some  regions  are  fairly 
homogeneous,  with  identifiable  common  needs  among  the  states, 
while  other  regions  are  more  diversified.    Thus,  it  is  easier  to 
identify  a  regional  agenda  in  some  regions  than  in  others.  Some, 
such  as  the  Southeast,  have  states  with  vivid,  distinct,  coherent 
needs,  and  there  has  been  a  great  deal  of  interaction  with  the 
lab  growing  out  of  those  needs. 

The  idea  of  labs  which  deliver  generic  services  across  the 
regions  does  not  work,  as  this  does  not  meet  the  needs  of  the 
states.    While  there  are  some  needs  corairon  to  all  states,  many 
are  state-specific.    Therefore,  three  levels  of  need  can  be 
identified:     1)  general  (common  to  all  regions  and  labs), 
2)  regional  (coherent  across  states  in  a  region),  and  3)  state- 
specific.    The  labs  would  probably  be  perceived  as  useful  if 
they  were  meeting  a  combination  of  these  needs.    The  labs'  task 
to  provide  assistance  to  state  decisionmakers  will  vary  in 
accordance  with  the  way  the  chief  state  school  officer  (CSSO) 
perceives  the  need  for  this  assistance. 

At  the  level  of  general  need,  there  is  also  a  need  for 
consistent  expertise  across  the  regions.    There  are  areas  where 
the  national  expertise  is  very  focussed,  such  as  reading  for 
disadvantaged  low  achievers,  and  the  labs  can  serve  an  important 
brokering  function  by  putting  the  states  in  touch  with  the 
national  experts.    The  btokering  function  can  also  take  place  at 
the  regional  level. 

Many  states  are  much  better  staffed  than  when  the  labs  were 
first  established,  and  can  do  things  themselves  that  the  labs 
were  set  up  to  do.    States'  capabilities  differ,  and  some  have 
good  expertise  in  many  areas.    But  the  key  is  for  schools  to 
identify  their  problems.    Their  felt  needs  are  often  more 
specific  than  the  research  questions  for  which  we  have  answers. 
It  would  be  useful  to  have  a  model  group  of  professionals  who 
could  circulate  among  the  schools  in  a  state  and  identify  the 


problems.    They  could  then  suggest  appropriate  experts  or  others 
who  are  dealing  successfully  with  the  particular  problems. 

Gordon  Ambach,  executive  director  of  the  CCSSO,  has 
testified  that  when  states  perceive  the  labs  as  useful,  it  is 
because  the  labs  have  net  their  individual  needs.    He  proposes 
that  the  labs  be  structured  and  funded  to  achieve  that  end, 
perhaps  by  having  a  set-aside  of  part  of  the  lab  funds  to 
provide  assistance  by  experts  of  the  states'  own  choosing,  on  a 
state-by-state  basis,  for  whatever  needs  the  state  identified. 

Gerald  Sroufe.  American  Educational  Research  Association 
(AERA) ;    We  are  talking  about  a  well-intentioned  effort  to  make  a 
20-year-old  system  work.    We  have  divided  the  country  unto 
regions,  but  there  are  few  regional  problems.    This  concept  also 
overlooks  technology  which  changes  the  need  for  face-to-focs 
communication  and  assistance. 

The  labs  are  not  really  labs  and  the  centers  are  not  really 
centers  because  of  underfunding.    Providing  policy  advice  to 
decisionmakers  is  not  a  lab  function.    The  research  is  good  and 
addresses  ideas  in  education,  but  it  does  not  lend  itself  to 
effective  classroom  application.    The  labs  should  receive  more 
funds,  and  should  do  fewer  things  better — perhaps  there  should  be 
fewer  labs  funded  at  a  higher  level.    Getting  the  research 
results  into  schools  is  the  labs'  function,  and  we  need  applied 
research  and  packaging  to  meet  the  states'  needs  as  they  arise. 
Labs  might  be  asked  to  do  just  one  thing,  such  as  get  cooperative 
learning  into  the  schools.    At  present,  the  labs  are  supposed  to 
serve  other  functions  as  well,  but  they  cannot  do  everything.  It 
would  be  more  useful  if,  instead  of  the  current  regional  focus, 
the  labs  had  a  topic  focus  and  were  engineers  of  educational 
ideas. 

Both  the  centers  and  labs  have  been  moving  from  their 
primary  focus,  e.g.,  the  centers  have  moved  into  dissemination, 
which  is  a  lab  function.    The  question  of  arti^  'ation  has  not 
yet  been  addressed. 

Observations  related  to  above  presentations 

The  following  statements  are  syntheses  of  comments  made  by 
one  or  more  participants;  they  do  not  reflect  consensus  on  the 
issues . 

Lab  structure  and  function 

•    The  amount  of  funding  for  independent  field  studies, 
which  promoted  a  competitive  process,  has  dwindled 
dramatically  in  the  last  few  years.    It  would  be  useful  to 
have  a  cost  t  :alysis  to  see  if  funds  provided  to  the  labs  as 
they  are  currently  structured  are  being  well  spent. 
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•  The  labs'  agenda  should  be  determined  by  need  and 
through  a  competitive  process  involving  schools  of 
education,  profit  and  nonprofit  organizations,  and 
associations. 

•  A  grassroots-driven  lab  system  would  have  implications 
for  administration  and  staffing  of  the  labs.    For  example, 
they  would  need  to  have  people  on  retainer  who  would  be 
flexible  and  capable  of  responding  to  many  different 
entities.    Many  needs  will  be  very  different  across  the 
states  and  regions,  so  it  would  be  necessary  to  identify 
the  needs  and  then  hire  people. 

•  We  need  more  short-range,  decision-oriented  research. 
There  is  a  class  of  issues  states  must  deal  with  for  which 
they  do  not  have  a  theoretical  base.    For  example,  some 
states  have  been  under  a  great  deal  of  pressure  to  lower 
class  size,  although  the  research  community  believes  that 
the  issues  are  much  more  complex  than  this  one  single 
factor.    Because  of  the  pressure,  Tennessee  undertook  a 
large,  controlled  experiment  at  its  primary,  upper 
elementary,  and  secondary  levels.    The  findings  showed  that 
lower  class  size  benefits  lower-level,  under-achieving 
students.    It  is  in  areas  such  as  this  that  the  labs  could 
help  by  providing  a  research  base  to  inform  decisionmaking. 

Getting  research  into  the  classroom 

•  As  an  illustration  of  what  is  needed,  we  can  look  at  the 
center  in  Pittsburgh  which  is  doing  research  on  how  people 
learn,  specifically  in  the  areas  of  reading,  math,  and 
writing.    This  research  is  a  rich  resource,  but  it  cannot  be 
used  in  thft  classroom  in  the  form  in  which  it  comes  from  the 
researc^rs.    There  must  be  someone  at  the  teaching  level 
who  can  provide  input  for  designing  a  way  to  use  the 
research  in  the  classroom.    There  are  some  models  of  this. 
For  example,  as  part  of  its  professional  development 
activities,  New  York  City  has  developed  techniques  that  will 
provide  concrete,  hands-on  ways  to  use  the  Pittsburgh  and 
Illinois  cognitive  research.    In  Orange  County,  Calif., 
staff  at  the  district  level  have  been  trained  to  work  with 
the  basic  research  and  translated  it  for  classroom  use. 

•  If  the  labs  were  structured  around  topics,  we  might  have 
a  lab  with  science  instruction  improvement  as  its  single 
mission.    This  lab  would  take  any  district  in  the  country 
and  show  it  how  to  use  the  research  in  classrooms.  At 
present,  the  labs  deliver  training  through  a  train-the- 
trainers  mechanism.    This  develops  networks  that  reach  to 
the  district  level  but  there  is  little  direct  work  with 
teachers  ♦ 
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Ronald  Field.  National  Conference  of  State  Legislators 
f NCSL) ;    In  the  past,  at  least  one  lab  was  responsive  to  the 
issue  of  drug  education  when  it  was  brought  to  ^hem  by  the 
governors  of  several  Nox^nwest  states.    The  governors'  offices 
did  not  use  *  lot  of  information  offered  by  the  lab,  but  there 
was  interest  shown  by  the  lab  in  a  zeal  policy  issue  that  »?as 
significant  to  the  governors  of  these  states.    The  current  tasks 
for  the  labs  include  serving  state  decisionmakers  needs  directly 
with  a  portion  of  their  funds;  however,  this  is  difficult. 

Education  is  a  major  policy  issue  in  the  states.  The 
Federal  Government  has  a  role  in  education;  however,  the 
responsibility  for  providing  a  system  of  common  schools  rests  on 
the  states.    States  delegate  this  responsibility  in  various 
ways—state  boards  of  education,  chief  state  school  officers 
(elected  or  appointed),  etc.    Since  1983,  state  legislatures 
have  appropriated  more  than  half  of  all  funds  ^jr  public 
education— it  is  the  largest  single  item  in  e\ery  state's 
budget.    This  puts  the  state  legislatures  back  into  the 
decisionmaking  process  regarding  what  education  will  look  at  and 
how  it  will  operate  in  a  given  state. 

In  this  situation,  the  state  legislators  have  a  great  need 
for  information.    The  National  Governors'  Association  has  been 
looking  for  ways  to  develop  more  information  sources,  and  one 
way  is  to  work  with  the  labs.    One  or  two  lab  directors  are 
particularly  interested  in  working  with  the  NCSL  to  serve  policy 
needs. 

When  we  look  at  the  lab  strategies  and  activities  that 
benefit  the  NCSL  constituency,  there  are  some  ways  the  regional 
labs  could  be  of  assistance.    For  example,  they  could  provide 
state-by-state  technical  assistance  regarding  a  particular 
policy  issue.    However,  it  is  not  clear  that  a  state  legislature 
would  call  upon  the  labs.    Labs  as  currently  structured  are  not 
the  kind  of  place  that  legislators  feel  comfortable  going  to. 
The  legislatures  see  the  labs  as  part  of  the  educational  system 
rather  than  as  an  information  system,  so  it  will  be  necessary  for 
the  labs  to  develop  a  relationship  with  tfs  legislatures  so  they 
will  know  the  labs  are  there  for  them  to  call  on.    The  NCSL 
could  perhaps  serve  as  a  disseminating  or  brokering  agent  for  one 
or  mor^  labs.    In  particular,  the  NCSL  State  Services  Office, 
which  provides  technical  ar*s''.stance  to  state  legislatures  in  a 
number       policy  areas,  mig.rt  serve  as  a  dissemination  or 
brokering  agent  fcr  the  labs. 

Since  1970,  there  has  been  growth  in  both  numbers  and 
capability  of  legislative  staffs.    This  has  included  research 
staff  rz  ^bei^;  however,  the  research  staff  is  still  small  in 
most  states  an J  cannot  do  a  great  deal  of  basic  research.  The 
need  now  is  to  provide  for  the  state  legislators  service  not 
unlilce  the  Congressional  Research  Service  for  the  Congress.  This 
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service  could  provide  results  from  other  states ,  universities, 
national  studies,  and  other  organizations  on  the  policy  issue  at 
hand.    A  national  applied  research  database  would  equalize  the 
states'  ability  to  draw  on  national  expertise  to  help  guide  their 
decisions.    That  is  a  big  task,  and  how  the  labs  might  feed  into 
it  is  an  open  question.    The  existing  computerized  database 
"Legisnet"  could  build  on  OERI  data  and  supplement  them  with  data 
from  other  sources. 

It  is  true  that  some  states  are  highly  politicised,  to  the 
point  where  every  legislative  committee  has  a  majority  and 
minority  ftaff .    If  information  is  made  available  to  one  side 
and  not  to  the  other,  problems  may  arise*    This  may  mean  that 
state-by-state  direct  help  from  the  labs  will  be  difficult,  and 
working  through  the  NCSL  would  be  mere  practical  and  prevent  the 
labs  from  being  drawn  into  political  situations.    The  most 
effective  way  to  work  with  legislatures  is  not  to  take  advocacy 
positions,  but  to  offer  options,  including  the  scope  and 
background  of.  the  issue  and  information  from  other  states  and 
sources,  as  well  as  recommendations  the  policymakers  might 
consider. 

Mary  Grace  Lucier.  National  Advisory  Council  on  Educational 
Research  ani  Improvement  ( NACERI ) :    Our  members  do  not  deal  with 
the  labs.    From  time  to  time,  lab  people  have  attended  our 
meetings  out  of  town,  but  they  did  not  tell  us  anything  new  or 
exciting  about  how  to  run  a  school.    We  cannot  criticize  their 
performance  from  personal  knowledge.    It  might  be  helpful  to 
inventory  what  the  current  labs  have  done  and  see  what  works, 
and  also  to  see  what  the  centers  have  done  that  is  useful  and 
could  be  retailed.    There  are  innovative  ideas  coming  from  the 
states  that  the  labs  could  broker  more  extensively. 

Related  observations  by  Charles  Stalford.  OERI 

•  The  lab/center  coordination  issue  has  been  under 
consideration  at  OERI.    The  Laboratory  Review  Panel  has 
discussed  the  need  for  further  coordination  among  labs, 
centers,  the  Educational  Resources  Information  Center 
(ERIC),  the  National  Diffusion  Network  (NDN),  and  other 
Department  programs.      Although  there  is  some  collaboration, 
it  is  not  a  clearly  articulated  system,  and  there  is  some 
overlap  in  developing  syntheses,  applied  research,  and 
dissemination. 

•  There  has  not  been  enough  money  to  do  the  kind  of  lab 
evaluation  OERI  would  like.    The  labs  do  a  self -evaluation, 
and  OERI  would  like  to  have  money  to  complement  that 
evaluation.    A  study  is  presently  being  conducted  through 
the  National  Center  for  Educational  Statistics'  (NCES)  Fast 
Response  Survey  System  to  determine  the  levels  of  receipt 
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and  use  by  public  school  districts  of  various  R&D  resources, 
including  those  provided  by  OERI  programs. 

Final  comments 

Alan  Farstrup.  IRA!    Given  the  smallness  of  the  resources, 
I  would  propose  more  radical  restructuring  and  more  focused 
efforts  rather  than  tinkering  with  the  20-year-old  lab 
system . 

Ramsay  Selden.  CCSSO!    There  should  be  a  real  caution  on  the 
principal  of  indirect  activities.    How  you  work  through 
intermediaries  must  become  very  thoughtful,  strategic,  and 
promising,  otherwise  you  will  accomplish  nothing. 

Ron  Field r  NCSLr     In  the  case  of  the  NCSL,  the  states  see  us 
not  so  much  as  an  intermediary,  but  as  a  trusted  extension 
of  the  legislatures.    We  would  serve  as  a  "buffer  of  under- 
standing,19 although  *;e  would  be  offering  the  same 
assistance  states  would  receive  if  they  went  directly  to  the 
labs. 
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TUESDAY,  JUNE  27 


Opening  comments  were  made  by  Ted  Sanders,  Under  Secretary 
of  the  U.S.  Department  of  Education •    Dr.  Sanders  noted  that  he 
had  been  involved  with  the  labs  in  several  capacities — as  a 
consumer,  a  board  member,  and  a  participant  in  the  previous 
recompetition  planning.    Dr.  Sanders  stated  that  he  had  come  to 
the  meeting  for  one  wvery  simple  purpose... to  symbolize  the 
importance  of  this  [planning]  activity." 

The  labs'  role  as  broker,  an  issue  raised  peripherally  in 
the  previous  day's  discussion,  was  the  predominant  theme  on 
Tuesday.    This  theme  was  approached  from  various  perspectives  and 
many  aspects  of  the  brokering  function  were  discussed  as  the 
participants  made  their  statements.    One  issue  was  the  extent  to 
which  individual  labs  should  seek  to  become  expert  in  many 
different  areas  of  education  or  whether  they  should  act  more  as 
brokers  in  referring  people  with  educational  needs  to  the  best 
source  for  help,  whether  in  a  lab  or  not. 

The  needs  and  interests  of  various  individual  associations 
were  also  discussed. 

Penny  Earley,  American  Association  of  Colleges  for  Teacher 
Education  ( AACTE ) :    This  association  includes  many  different 
kinds  of  institutions.    In  most  regions,  our  members  have  worked 
successfully  with  the  labs.    A  useful  aspect  of  the  lab/center 
configuration  was  the  concept  that  the  centers  would  do  the 
basic,  empirical  research  and  the  labs  would  do  dissemination; 
however,  this  has  been  blurred  over  the  years. 

As  the  institutions  which  prepare  people  to  go  into  the 
classroom  as  teachers,  this  constituency  can  be  seen  as 
consumers  who  are  tied  closely  to  the  labs.    In  one  region, 
there  is  a  formal  relationship;  in  several  others,  schools  of 
education  are  involved  in  governance  of  the  labs.    In  some  cases, 
the  relationship  is  professional,  collegial.    ERIC  is  also  used 
a  great  deal  in  teacher  education.    The  AACTE  membership  strongly 
encourages  linkages  between  the  institutions  and  the  labs  and 
centers.    The  issue  is  whether  such  relationships  should  be 
prescribed  or  encouraged.    Our  membership  would  probably  fall 
between  these  two  positions. 

When  we  look  at  the  institutions'  relationships  with  the 
centers  and  labs,  we  sea  an  organizational  distinction  between 
research  generating  institutions,  such  as  the  University  of 
Michigan,  and  institutions  which  use  research  in  practitioner 
preparation,  e.g.,  Western  Michigan  University.    Those  which 
generate  research  will  tend  to  have  closer  ties  with  the 
knowledge  production  side  of  our  business,  while  those  which 
utilize  knowledge  based  on  research  will  be  more  closely  linked 
to  the  labs.     In  those  cases,  the  lab  forms  the  link  between  what 
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happens  in  the  centers  and  what  happens  in  the  other  (knowledge 
utilization-oriented)  institutions. 

Our  membership  feedback  indicates  that  some  of  the 
institutions'  relationships  with  the  labs  seem  to  be  based  on 
"institutional  and  individual  personality  traits."      If  an 
institution  is  committed  to  outreach  and  is  visionary,  it  will  be 
more  likely  to  form  relationships  with  entities  such  as  the  labs. 
Institutions  which  see  their  mission  more  narrowly  are  less 
likely  to  form  such  relationships.    Our  organization's  hope  would 
be  that  the  bulk  of  our  members  would  see  opportunities  in 
working  with  the  labs,  ERIC,  and  other  OERI-funded  programs. 

Michael  Psdan,  Institute  for  Educational  Leadership  flELI: 
I  have  a  general  question  about  whether  you  are  attempting  to 
reconcile  the  pre-1985  strategy  of  large-scale  product 
development  and  the  indirect  service  strategy  implemented  in 
1985.    Instinctively  and  intuitively  I  favor  the  direction  OERI 
moved  in  1985,  as  I  think  it  makes  sense  politically  and 
substantively  in  terms  of  reaching  the  field.    I  do  not  know  the 
political  /mances  or  the  operational  pluses  and  minuses  of  the 
strategies,  but  I  do  think  the  1985  direction  makes  sense. 

The  problems  of  research  diffusion  and  brokering  information 
from  the  universities  remain  difficult  ones.    There  is  very 
little  currency  in  any  professional  field  in  terms  of  people  who 
upend  their  lives  as  brokers,  translating  the  research  into 
practice  in  the  field,    They  are  a  rare  and  courageous  breed,  and 
they  have  great  difficulty  gaining  currency  in  either  the  school 
systems  or  the  universities. 

Whatever  the  Federal  Government  can  do  to  devise  a  strategy 
(perhaps  a  combination  of  the  pre-  and  post-1985  ones)  that  will 
reward  institutions,  be  they  teacher  education  institutions, 
state  education  agencies,  or  <  .xer  intermediaries  that  will 
perform  the  brokerage  functic  *  effectively,  will  be  welcome, 
because  no  one  else  understands  it  or  is  doing  it. 

Betty  Hale,  Institute  for  Educational  Leadership  (IELl:  I 
am  interested  in  how  independent  research  being  done  in 
universities  gets  into  the  pipeline  and  fed  into  the  ERIC  system. 
A  lot  of  the  Federal  Government's  education  research  agenda  is 
funded  through  the  labs  and  centers,  and  I  am  curious  as  to  how 
all  tte  pieces  can  be  pulled  together. 

If  I  directed  a  regional  laboratory  and  wanted  to  serve 
people  better,  I  would  suggest  some  focus  group  conversations 
with  opinion  leaders  among  the  ranks,  such  as  teachers,  to  find 
out  how  to  serve  people  in  the  field.    It  could  be  very  fruitful 
to  have  a  conversation  around  the  question  of  how  the  people  in 
the  field  get  their  information.    The  issue  goes  beyond  name 
recognition.    It  has  to  do  with  people  knowing  about  resources 
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and  where  they  can  turn  for  help  if  they  have  issues  they  want  to 
resolve.    We  know  people  are  out  there  generating  information  and 
coming  up  with  new  strategies  that  could  be  put  into  practice. 
The  real  challenge  is  to  sake  sure  that  information  gets  to  the 
richt  people. 

Lew  Rhodes.  American  Association  of  School  Administrators 
(AASA) :    Our  constituency  has  a  great  deal  of  information  on  the 
labs  and  centers.    For  us  tne  issue  is  how  the  situational 
decisionmaker — superintendent ,  principal ,  or  teacher — can  use  the 
research  information.    The  knowledge  usually  comes  to  the 
practitioner  through  a  personal  interest  to  1 ind  out  something, 
through  his/her  own  experience,  or  through  peers.    But  there  is 
very  little  vertical  communication  in  this  profession,  so  people 
at  the  various  levels  often  do  not  realize  that  those  at  other 
levels  have  similar  values  and  goals.    The  thing  that  has  been 
missing  most  of  the  t'me  has  been  opportunities,  through 
"trusted  brokers,"  to  exchange  information  not  only  with  peers, 
but  also  vertically  around  the  same  issue.    We  must  provide 
opportunities  to  communicate  across  the  levels  and  to  reflect 
together  on  our  mission. 

The  labs  can  play  a  critical  role  as  brokers  between  the 
basic  researchers,  who  often  do  not  understand  practitioners, 
and  the  research  users.    For  a  while,  the  labs  saw  dissemination 
as  a  one-way  process,  but  there  are  labs  which  understand  that  it 
has  to  be  a  two-way,  interactive  process. 

We  want  to  make  the  laLs  trusted  brokers,  but  this  causes  a 
problem  when  it  comes  to  evaluating  the  facilitator /broker  role. 
Site-based  management  efforts  are  failing  in  many  areas  because 
superintendents  and  central  offices  do  not  have  the  skills  needed 
to  act  as  brokers.    In  a  way,  OERI  is  like  the  central  office  of 
a  school  district,  in  that  it  is  perceived  as  a  "blob.1*    If  the 
labs  are  to  play  a  role  as  process  facilitators,  OERI  needs  to 
look  at  its  own  structure  and  seek  to  model  a  facilitative 
process  with  the  labs  themselves. 

Question  from  Charles  Stalford,  OERI:     In  the  discussion 
yesterday,  we  heard  that  it  would  be  desirable  for  the  labs  to 
be  able  to  respond  to  the  states'  needs  as  they  occur  and  to 
assume  the  "trusted  broker n  role.    How  could  the  labs  be 
organized  to  be  prepared  to  offer  assistance  in  situational 
decisionmaking? 

Lew  Rhodes,  AASA:    With  situational  decisionmaking,  you 
only  need  help  when  you  need  it.    You  turn  to  a  trusted  broker, 
who  either  knows  what  you  want  or  who  can  put  you  in  contact  with 
someone  else  who  does.    It  takes  a  while  to  build  up  such 
relationships.    You  have  to  get  a  sense  that  the  broker  knows 
what  your  problems  are  like.    The  easy  one  to  facilitate  is  to 
have  enough  opportunities  where  people  get  together  with  other 
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people  who  have  similar  situations  and  know  who  to  call.  That  is 
what  most  of  us  do. 


I  was  involved  as  an  observer  when  the  National  Institute  of 
Education  was  created.    I  went  on  to  become  a  contractor  working  * 
with  the  labs,  and  I  now  represent  the  users  of  the  information. 
In  the  early  days,  one  objective  was  to  see  how  the  project 
monitors  could  play  a  more  helpful  role  than  being  just  "paper 
pushers. *    In  an  organization  such  as  OERI,  there  are  certain 
decisions  that  go  with  the  policy  of  the  "board"  and  that  must  be 
done  as  the  administration  changes.    But  in  OERI  there  is  an 
infrastructure  made  up  ox  people  with  a  base  of  experience  and 
wisdom  that  has  been  sustained,  even  as  the  political  situation 
has  changed  periodically.    These  people  could  play  a  supportive, 
facilitative,  brokering  role  to  help  the  labs  be  effective  places 
for  creating,  gathering,  and  sharing  information. 

Michael  Usdan.  IEL;    Part  of  the  answer  to  the  question  of 
how  to  assist  situational  decisionmaking  is  the  anticipatory 
skill  of  sensing  the  emerging  kev  educational  issues.  For 
example,  restructuring  is  currently  receiving  a  great  deal  of 
attention,  but  no  one  knows  quite  what  it  means.    There  is  a  need 
to  identify  a  set  of  nationally  salient  issues.    The  labs  can 
tnen  network  and  pull  together  around  those  issues  to  build 
capacity  to  respond.    The  labs  are  uniquely  positioned  to  play 
the  broker  role  in  schools  and  the  wider  community.    Maybe  for  a 
change,  the  labs  can  help  the  education  enterprise  get  ahead  of 
the  action,  rather  than  be  reactive. 

Dena  Stoner.  Council  for  Educational  Development  and 
Research  ( CEDaR) !    I  am  struck  by  the  brokering  concept.  Ir. 
looking  at  the  idea  of  wisdon,  we  get  in  a  simplistic  mold  and 
view  wisdom  as  coming  from  the  top  down.    We  take  the  research 
and  "tamp  it  down"  to  the  place  where  it  can  flow  into  the 
schools.    In  thinking  about  situational  decisionmaking  and 
practice,  I  see  labs  using  wisdom  that  flows;  up  from  within  the 
system.    We  think  about  brokering  in  terms  of  disseminating  from 
the  top  down,  but  the  labs  should  help  translate  wisdom  both  up 
and  down  in  the  system. 

The  broker  should  be  a  way  station  between  a  place  to 
reflect  and  a  place  to  have  action.    There  is  a  sense  from 
brokering  activities,  also,  that  is  different  from  other  sources. 
Such  wisdom  may  encourage  risX-taking.    The  labs  have  a  critical 
role  as  nurturing  and  inspirational  entities;    it  is  part  of 
breaking  down  the  idea  of  top-down  wisdom.    This  is  an 
opportunity  for  the  Department  of  Education  to  model  that 
nur curing  role. 
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Additional  points  of  discussion  on  brokering 


The  statements  below  are  syntheses  of  comments  made  by 
various  participants,  and  do  not  represent  consensus  on  the 
issues. 

•  In  addition  to  the  nationally  salient  issues  that  cut 
across  the  labs,  there  are  issues  which  are  regionally-  or 
state-specific.    How  could  those  be  reconciled?    The  labs 
could  respond  to  both  kinds  of  issue4*  •    The  issues  are 
fluid,  so  the  labs'  ability  to  serve  could  be  fluid. 

•  Brokering  is  not  only  giving  information.    It  also  is 
helping  people  reflect  on  what  they  should  do,  what  is 
working,  and  when  it  is  best  not  to  move.    Issue  sensing  is 
important,  but  there  may  be  a  fine  line  between  it  and 
agenda  setting.    It  is  important  that  the  labs  not  be  seen 
as  prescriptive. 

•  Should  every  lab  develop  the  capacity  to  respond  to  the 
restructuring  issue,  or  should  the  labs  be  brokers  to  some 
central  source  of  wisdom  on  the  subject?    Every  lab  should 
develop  the  capacity  to  respond  to  restructuring  needs,  as 
there  is  no  other  place  to  go  for  help  with  this  problem. 
The  nature  of  the  solicitation  for  proposals  will  determine 
the  labs'  relevance.    We  know  that  the  nature  and  scope  of  a 
problem  changes  and  is  individualized  in  different 
educational  settings,  but  we  seldom  look  at  research  and  say 
that  it  can  be  implemented  in  various  ways  to  meet  different 
needs.    The  labs  should  have  a  mindset  that  allows  them  to 
build  this  capacity. 

•  There  are  many  people  in  the  education  field  who  have 
some  leve]  of  understanding  of  many  things  they  deal  with. 
But  they  also  need  to  know  where  they  can  turn  for  in- 
depth  information  in  specific  areas,  and  it  is  here  that 
the  trusted  broker's  role  becomes  essential.    There  should 
also  be  an  evaluative  element,  as  we  sometimes  find  that 
what  research  has  told  us  to  expect  is  not  what  is 
happening.    The  labs  should  be  aware  of  the  ne^d  for 
evaluating  information. 

Following  the  discussion  on  brokering,  comments  were 
solicited  regarding  specific  interests  of  associations  in 
relation  to  the  lab  program. 

Marily  DeWall.  National  Science  Teachers  Association 
(NSTA^ :    Teachers  at  the  college  level  are  very  interested  in 
research  from  the  universities,  and  the  NSTA  has  disseminated 
research  findings  by  publishing  several  popular  documents.    I  am 
not  clear  as  to  whether  or  not  NSTA  members  are  really  aware  of 
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the  centers  and  labs,  although  at  one  tine  a  close  working 
relationship  with  the  Far  West  Lab  existed. 

NSTA  has  some  concerns  that  are  relevant  to  the  labs.  Our 
primary  concern  is  the  status  of  science  education.    This  has 
received  a  great  deal  of  publicity,  particularly  regarding  the 
lack  of  science  education  at  the  elementary  level.    Teachers  are 
not  taught  to  teach  science  at  this  level,  and  we  need  better 
preservice  and  inservice  training.  The  NSTA  is  beginning 
certification  in  nine  science  areas.    This  will  be  an  extra 
credential  for  teachers,  and  is  a  more  stringent  certification 
than  is  generally  given  by  the  state.    We  are  also  interested  in 
laboratories  and  equipment,  as  studies  show  that  hands-on  science 
education  has  good  results.    We  are  seeing  more  reliance  on 
textbooks  and  less  hands-on  education,  which  is  not  going  to  make 
for  students  who  want  to  pursue  science. 

We  are  interested  in  middle  school/ junior  high  structuring, 
as  we  are  beginning  to  get  some  information  that  segregating 
students  into  middle  school  is  not  practical  and  a  return  to  the 
K-8  structure  might  be  indicated.    We  alrso  are  curious  about 
distance  learning.    Although  it  generally  is  not  practicable  for 
teaching  science,  we  know  it  is  being  done,  particularly  in  areas 
where  there  is  a  shortage  of  teachers.    There  is  an  interesting 
project,  JASON  Project,    which  uses  a  satellite  to  show  live 
explorations  in  the  Mediterranean  Sea. 

Cur  highest  priority  is  restructuring  the  scope,  sequence, 
and  coordination  of  science  instruction  in  secondary  schools; 
only  20  percent  of  the  student  population  studies  chemistry  and 
physics     We  need  more  teacher  training  and  curriculum  revision. 
With  a  grant  from  the  National  Science  Foundation,  we  held  a 
major  strategic  conference  with  superintendents,  teachers,  and 
others  to  look  at  these  issues.    We  are  planning  five 
implementation  centers  to  put  the  restructuring  effort  into 
practice,  beginning  in  1990-91  with  the  7th  grade.    We  also  have 
applied  for  Department  of  Education  funds  tor  development  of 
curriculum  materials  in  the  first  year* 

The  average  teacher  or  curriculum  developer  goes  to  the 
national  NSTA  or  their  state  organization  for  help  in  designing 
courses.    Host  of  the  states  have  a  science  teachers' 
organization.    Some  teachers  and  curriculum  developers  go  to  the 
teacher  education  school  at  a  university  with  which  they  have 
ties.    The  extent  to  which  the  labs  are  known  in  this 
constituency  is  not  clear,  but  the  labs  could  be  useful  both  in 
gathering  and  brokering  information  for  us.    We,  in  turn,  would 
help  disseminate  what  the  laboratories  are  doing.    We  also  need 
help  in  retraining  teachers,  as  many  are  teaching  in  areas  where 
they  have  nad  little  or  no  coursework. 


16 


Adria  Thomas.  National  School  Boards  Association  (UShk): 
The  relationship  between  members  of  the  NSBA  and  the  labs  is  not 
clear.    However,  the  national  organization  has  worked  with  the 
Far  West  Lab  on  school  board  development.    This  issue  is 
receiving  increased  attention.    And  with  states  becoming  more 
involved  in  setting  policy  and  other  issues,  school  boards  need 
more  training.    School  boards  particularly  need  information  in 
the  area  of  implementing  effective  reorganization  practices  with 
the  same  amount  of  money  that  has  been  available  for  the 
existing  board  structure.    The  labs  could  be  useful  in  this  area. 

Frederick  Bricrham.  National  Catholic  Educational 
Association  f NCEA1 :    The  association  has  a  broad  constituency. 
We  see  the  labs  as  valuable  resources  for  private  schools,  as 
well  as  for  public  ones.    I  am  not  aware  of  how  extensively  our 
schools  use  services  of  the  labs.    Some  of  our  schools  have  used 
the  lab  in  the  northeast  region  in  the  areas  of  curriculum 
development  and  business  partnerships.    Some  were  going  to  use 
the  lab  in  the  southwest  region  on  a  special  project,  but  that  is 
not  active  at  this  time. 

Our  goal  *s  to  increase  the  number  of  collaborative  models 
between  public  and  private  schools,  particularly  regarding  the 
use  of  community  resources.    The  labs  would  be  useful  in  this 
area,  and  we  want  to  make  their  services  known  to  our  schools  in 
every  region.     In  their  role  as  brokers,  the  labs  could  be 
catalysts  to  help  break  down  walls  between  the  public  school 
bureaucracy  and  the  private  schools  and  establish  a  sense  of 
community  and  shared  educational  goals  between  the  two  groups. 

There  is  a  wealth  of  knowledge  which  schools  crave  to 
share.    To  what  extent  are  the  labs  using  technology  in 
obtaining  and  disseminating  information?    They  could  also  help 
integrate  technology  into  the  educational  process,  both  as  a 
learning  tool  and  as  a  resource  for  administrators.  Technology 
has  the  ability  to  bring  people  together,  and  we  need  both  the 
equipment  and  people  who  are  conversant  with  it.    This  is  an  area 
where  the  labs  could  be  useful. 

Sara  Wallace.  National  Council  for  the  Social  Studies 
(NCSS) :    I  am  not  sure  we  have  a  direct  link  with  the  labs. 
However,  we  are  interested  and  try  to  be  informed  about  what  the 
labs  are  doing.    The  NCSS  uses  social  studies  as  an  unbrella  term 
that  embraces  history,  geography,  economics,  anthropology, 
social  psychology,  sociology,  and  political  science.    The  NCSS 
has  a  national  council  which  represents  26,000  members.     It  also 
h*s  a  group  of  college  and  university  professors  who  work  on 
r    earch  and  curriculum  design  and  a  group  of  supervisors  who 
look  at  state  and  local  curricula.    Along  with  the  national 
staff,  these  two  groups  determine  what  is  needed  in  the  field  to 
meet  local  needs. 


Out  of  a  5-year  study  of  members'  perceived  needs,  models 
for  curriculum  scope  and  sequence  have  been  developed  and  will  be 
printed.    I  do  not  know  how  the  labs  will  fit  into  this,  other 
than  as  curricula  are  designed  at  the  state  and  local  level,  they 
will  need  to  be  evaluated.    We  are  as  concerned  about  content  in 
this  diverse  group  of  subjects  as  we  are  about  the  need  for 
students  to  develop  critical  thinking  in  relation  to  the 
subjects.    The  labs  could  have  a  role  in  designing  an  objective 
evaluation  process.    And  I  concur  with  the  idea  that  technology 
could  help  break  down  the  isolation  many  teachers  experience  by 
providing  a  way  to  share  information. 

Another  concern  is  teacher  certification.    We  are  working 
on  this,  and  are  looking  at  standards  for  college  programs 
dealing  with  initial  credent ialing.    Many  social  studies 
teachers  are  teaching  in  areas  which  they  are  not  qualified  for 
and  do  not  want  to  be  in.    We  want  to  see  teachers  trained  and 
competent  to  teach  in  the  areas  where  they  are  compatible.    I  do 
not  know  how  regional  laboratories  can  fit  into  that.  Finally, 
we  would  like  to  see  more  social  studies  taught  at  the  elementary 
level,  as  we  believe  students  can  learn  a  great  deal  more  at  this 
stage  than  we  are  currently  offering. 

Additional  points  of  discussion 

The  issue  of  technology,  first  raised  by  Frederick  Brigham, 
was  discussed  at  some  length.  Other  topics  included  1)  regional 
configuration  and  governance  and  2)  indirect  service  strategy. 

Technology 

Nelson  Smith.  PERT:     in  our  technological  age,  we  have  the 
ability  to  draw  on  the  world  instantaneously  to  put  together 
wisdom  and  have  it  bubble  up  or  down  in  any  way  the  sender 
and  receiver  decide.    If  a  lab  is  operating  in  a  given 
region  of  the  country  and  yet  can  draw  from  all  around  the 
country  and  the  world  and  disseminate  the  same  way,  does 
this  have  implications  for  the  nature  of  the  regional 
services  the  labs  deliver? 

Dena  stonar.  CEDaR:     I  am  using  the  concept  of  wisdom  not  as 
something  that  can  necessarily  be  captured  and  filed,  but  in 
a  broader  sense.    You  can  use  technology  to  do  the  other 
things  that  laboratories  do,  e.g.,  in-servicing  roles,  their 
own  development,  and  their  own  research  activities  that  they 
do  in  collaboration  with  others.    But  we  need  to  make  sure 
that  we  are  using  the  word  "wisdom"  in  more  than  just  a 
data-informational  sense. 

Lew  Rhodes.  AASA:    The  word  "wisdom"  is  not  the  problem — the 
problem  is  technology  and  the  issue  of  isolated 
practitioners.    What  technologies  do  we  have  today  that 


18 


would  allow  people  the  access  to  information  they  need  when 
they  need  it  and  would  allow  them  networking,  trust,  and 
support?    We  have  the  technology,  but  most  of  it  is  being 
misused  because  it  is  being  applied  the  old  delivery 
mechanism  way.    The  ideal  thing  would  be  for  every  teacher 
and  administrator  to  have  a  computer  at  home,  where  they 
would  have  time  to  reflect.    But  this  will  not  happen.  So 
what  is  working  nov  is  conferences  where  there  is  a 
facilitator  or  broker  who  keeps  things  going.    But  these 
things  could  be  done  much  bettor  electronically,  with 
interactive,  pure  exchange  or  audio  conferencing,  which 
would  allow  people  to  do  more.    The  people  who  are  doing 
electronic  conferencing  now  are  operating  bulletin  boards, 
which  is  a  poor  concept  because  once  you  have  seen  what  is 
there,  you  stop  looking. 

OERI  could  design  its  reporting  systems  for  the  labs  to 
require  that  they  feed  back  their  "learnings"  so  they  can  be 
shared  with  others.     I,  could  be  mandated  that  they  network 
access  points.    We  know  that  an  isolated  practitioner  is 
going  to  turn  to  someone  she/he  trusts,  either  in  a 
university,  an  agency,  or  the  peer  group.    How  can  the  labs 
network  the  people  the  practitioner  is  going  to  turn  to?  I 
would  like  to  see  something  in  the  RFP  to  pull  the  labs  into 
the  process  and  shape  the  way  people  can  continually  learn. 

Dena  Stoner.  CEDaR:    We  can  use  technology  and  continue  to 
have  a  regional  configuration  and  networks.    They  are  not 
incompatible.    Policymakers  often  think  that  technology  is 
the  answer,  particularly  in  the  case  of  isolated  schools, 
but  it  is  not;  the  real  issue  is  substance.    Technology  is 
not  the  role  of  the  labs.    It  is  a  tool,  a  means  for 
expressing  the  role  of  the  labs,  which  is  multif aceted  given 
the  demands  of  a  region. 

Regional  configuration  and  governance 

Penny  Earley.  AACTE*    A  subtheme  of  the  discussion  is  the 
integrity  of  the  existing  regions  and  whether  or  not  they 
are  efficacious  and  necessary,  particularly  with  the 
technology  now  available.    I  think  that  the  regions  are 
necessary,  as  they  serve  a  function  that  is  separate  from 
whether  or  not  they  interact  with  each  other  or  go  across 
regional  lines  to  do  some  of  their  work.    The  regions  serve 
a  function  by  creating  a  management  unit  which  includes  a 
network  or  community  of  states,  around  the  lab,  and  people 
are  comfortable  working  with  one  another  in  that  community. 
I  would  hope  that  OERI  would  give  some  serious  consideration 
co  the  importance  of  the  communities  that  have  developed  in 
the  regions  and  the  consequences  to  those  educational 
organizations  if  there  were  a  reconfiguration. 
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Nelson  Smith.  OERI:    The  issue  of  regional  configuration 
arose  in  the  June  26  meeting  as  part  of  the  question  about 
the  states'  interests  and  whether  or  not  the  states  are 
sufficiently  served  by  the  representation  they  have  on  the 
governing  boards.    We  invite  discussion  on  this  subject. 

Michael  Usdan.  TEL:    For  administrative  reasons ,  you  have  to 
decentralize  structurally.    The  educational  reform  movements 
of  the  mid-1980 's  were  led  by  the  states.    1  believe  that  a 
major  issue  now  is  how  the  state  and  local  relationship  will 
be  redefined  in  the  1990 's.    I  think  there  has  been  a 
consensus  that  meaningful  changes  beyond  the  states' 
prescriptions  will  take  place  at  the  district  and  school 
levels.    I  would  argue  that  one  of  the  networking, 
brokering,  and  convening  roles  of  the  labs  in  1990  will  be 
to  serve  as  a  force  that  can  transcend  the  vested  interests 
of  state  officials,  associations,  and  local  groups  and 
promote  meaningful  dialogue.    The  labs  must  project  the  fact 
that  they  are  structured  as  neutral  brokers,  and  this  should 
be  considered  in  any  effort  to  reconfigure  the  labs. 

Nelson  $mlth,  QERI:    This  would  mean  that  the  governing 
bodies  might  pay  as  much  attention  to  the  local  groups  in 
the  1990 's  as  they  have  to  state  groups  in  the  1980 's.  I 
think  that  the  country  is  in  a  different  place  in  1989  and 
1990  than  it  was  in  1985  in  terms  of  the  respective  roles  of 
the  state  and  district. 

Michael  Usdan P  TEL:     I  am  not  totally  familiar  with  your 
governance  structure.    However,  I  know  that  the  chief  state 
school  officers  play  a  critical  role  in  the  current 
configuration,  and  that  education  remains  a  legal 
responsibility  of  the  states.    But  somehow  you  need  to 
ensure  that  local  perspectives  are  included.    "Local"  is  not 
easily  defined,  because  it  is  more  than  the  district  level. 
Increasingly,  it  is  going  to  mean  the  building  level.    It  is 
starting  in  Chicago  and  other  places.    It  is  the  recon- 
figuration of  collective  bargaining.    In  many  parts  of  the 
country,  there  is  a  grassroots  movement  related  to 
governance • 

Nelson  Smith.  OERI:    What  about  other  regional  associations 
such  as  the  Southern  Growth  Policies  Board  and  other 
preformed  bodies  that  include  education  among  their 
interests? 

Michael  Usdan.  I EL:     I  think  linkages  should  be  made  between 
those  groups  and  the  labs  in  their  regions.    If  I  were 
involved  with  the  RFP,  I  would  ensure  that  it  included  a 
perspective  to  help  break  people  in  traditional  educational 
institutions  out  of  their  parochial  and  narrow  turf.  What 
the  public  schools  have  going  for  them  in  the  future 
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politically  is  the  linkage  with  economic  development.  The 
business  community  and  political  community  are  linked 
together  in  terms  of  economic  development ,  and  this  is  why 
they  are  interested  in  the  public  schools. 

Indirect  service  strategy 

The  following  statements  are  syntheses  of  comments  and  do 
'ijot  reflect  consensus. 

•  The  indirect  service  strategy,  whereby  the  labs  are  to 
work  with  and  through  existing  organizations  to  improve 
schools  and  classrooms,  should  be  reconsidered.  Charles 
Stalford  noted  that  the  Laboratory  Review  Panel,  which 
advises  the  Assistant  Secretary,  has  commented  on  the 
indirect  strategy  in  its  1987  and  1989  reports. 

•  In  answer  to  a  question  on  the  best  way  to  design  the 
labs  to  serve  district-level  needs,  some  participants  felt 
that  combining  the  indirect  strategy  with  other  delivery 
modes  might  be  best. 

Final  cr>«^ntg 

Lew  Rhodes f  AASA:    As  OERI  moves  toward  putting  the 
recompetition  solicitation  on  paper,  it  should  think  about 
the  two  worlds  it  deals  with,  which  do  not  connect.  The 
research  designer  tends  to  see  the  world  as  a  delivery 
mechanism  in  which  the  new  context  is  the  stimulus  and 
children  learn  the  response.    In  the  world  of  the 
practitioner,  the  child  is  the  stimulus  and  teaching  is  the 
response.    What  is  missing  between  these  two  worlds  is  ;/hat 
biology  calls  osmosis,  where  an  agent  allows  two  things  that 
do  not  connect  to  exchange  what  they  need.    There  must  be 
mechanisms  to  allow  these  two  worlds  to  exchange  ideas  and 
information  from  a  basis  of  understanding  and  trust.  The 
lab  program  can  be  a  vital  resource  in  accomplishing  this. 

Dena  Stoner.  CEDaR !    We  have  not  discussed  the  issue  of  the 
role  the  labs  play  in  working  with  and  for  policymakers.  We 
must  recognize  the  fact  that  policymakers  are  in  action. 
They  cannot  w?'t  for  research  studies  when  they  need  to  take 
action.    The  labs  have  knowledge,  and  when  they  are  asked 
for  it  by  teachers,  boards,  CSSO's,  or  state  legislatures, 
they  respond.    In  a  sense,  the  labs  are  risk-takers.  We 
have  not  talked  about  the  fact  that  the  U.S.  Congress  also 
looks  to  the  labs  for  knowledge  and  for  the  labs'  opinions 
on  issues  which  are  in  action.    The  labs  play  a  critical 
role  with  policymakers  in  the  classroom  and  elsewhere,  and 
when  a  decision  is  made,  the  nature  of  the  problem  is 
immediately  changed.    We  need  to  remember  that  the  situation 
is  always  fluid. 
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Charles  Stalford.  OERI:    I  recognize  the  fact  that  labs  do 
provide  information  to  the  Congress.     In  a  formal  sense,  the 
mission  of  the  lab  is  to  deliver  services  to  a  region,  but 
that  does  not  preclude  doing  other  things.    Could  you 
discuss  the  implications  of  your  comments  on  Congress  as  an 
audience? 

Dena  Stoner.  CEDaR;    The  Congress  has  listened  to  the  public 
and  has  authorized  the  labs,  centers,  NCES,  and  other 
entities.    It  has  oversight  responsibility,  and  thus  is  an 
audience  for  the  labs. 

Pepny  EarleyP  AACTE:    We  have  to  remember  that  when  we  talk 
to  members  of  Congress  in  our  respective  roles,  they  will 
often  ask  what  the  implications  are  for  their  states.  That 
is  where  the  labs  are  important.    If  there  is  a  resource 
that  serves  the  congressional  member's  state  or  region,  the 
member  will  want  to  know  what  that  resource's  impact  will  be 
on  the  particular  state.    I  think  that  perhaps  the  way  the 
labs  will  influence  Federal  policy  is  by  making  connections 
between  the  states/districts  and  some  of  the  particular 
substantive  issues  they  are  considering. 
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1  PROCEEDINGS 

2  (9:00) 

3  MR*  SMITH:     I'm  Nelson  Smith  for  Programs  for 

4  Improvement  of  Practice,  PIP,  and  I'd  like  to  welcome  you 

5  to  this  meeting, 

6  As  you  know,  we've  had  a  process  for  advising  us 

7  on  the  i  ecompetition  of  Regional  Educational  Laboratories 

8  and  the  products  of  that  process  are  on  the  table  back 

9  there,  a  number  of  commission  papers,  the  report  of  the 

10  Laboratory  Review  Panel,  all  of  which  we  want  to 

11  disseminate  so  that  people  can  be  informed  as  they  offer 

12  their  own  advice  and  encouragement  to  us  in  this  process, 

13  We're  going  to  be  doing  more  meetings  next  month. 

14  The  purpose  of  this  meeting  today  is  to  ask  from  education 

15  associations  and  other  related  organizations  who  have  a 

16  stake  in  the  outcome  of  this  rc^ompetiton  t  *  r  views  as 

17  to  how  we  ought  to  proceed. 

18  You've  gotten  a  letter  which  outlined  a  number  of 

19  categories  of  questions  that  we'd  like  to  as*  of  you. 

20  Before  we  begin,  I  would  simply  say  we  hope  you  can  help 

21  us  answer  those  questions.    We  also  hope  that  you  can  go 

22  as  far  as  you  feel  comfortable  going  beyond  those 

23  questions. 

24  The  recompetition  of  labs  is  a  highly  complex 

25  matter  and  there  are  innumerable  possible  configurations 
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1  and  approaches  to  the  organization  of  the  labs'  structure. 

2  So  we  hope  that  you  will  think  in  as  large  terms  as 

3  possible  both  about  these  questions  and  any  others  that 

4  come  into  your  minds  while  we're  talking  this  moring. 

5  So  with  that,  I  would  just,  again,  say  welcome 

6  and  then  turn  it  over  to  Charlie  Stalford. 

7  MR.  STALFORD:    Thank  you,  Nelson.    I'm  going  to 

8  chair  the  meeting  this  morning.    Before  we  go  any  further, 

9  however,  I  think  it's  appropriate  that  we  have  an 

10  opportunity  for  everyone  to  introduce  themselves  both  here 

11  at  the  table  and  those  who  are  around  the  the  table. 
\2  partially  for  our  own  information,  partially  for  the 

13  information  of  the  Reporter  and  the  person  synthesizing 

14  this  meeting. 

15  The  meeting  will  have  a  verbatim  transcript 

16  prepared  by  Rita  Shepard,  seated  to  my  right  at  the  end  of 

17  the  table.    Anne  App  will  prepare  a  short  written 

18  synthesis  of  the  meeting  as  well.    I'll  talk  about  the 

19  purposes  later. 

20  So  with  that,  let  me  stop  and  start  the 

21  introductions  around  the  table. 

22  MR.  MACK:    I'm  Dave  Mack,  I'm  a  long  time  person 

23  working  with  OERI  and  the  Regional  Educational 

24  Laboratories  Program,  Director  of  the  Educational  Networks 

25  Division  that  manages  the  Regional  Laboratory  Program. 


581 


t 


6 


1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 

P 

ERJC 


MR.  FIELD:    I'm  Ron  Field  with  the  National 
Conference  of  State  Legislatures,  and  I'm  the  Senior  Staff 
Director  for  the  Policy  Committee  on  Education  and  Job 
Training, 

MS,  LUCIER:    My  name  is  Mary  Grace  Lu;:ier,  and 
I'm  the  Executive  Director  of  the  National  Advisory 
Council  on  Educational  Research  and  Improvement, 

MR.  SELDEN:    Ramsey  Selden  with  the  Council  of 

y 

Chief  State  School  Officers,  State  Education  Assessment 
Center. 

MR.  LONG:    Rich  Long,  and  I  work  with  IRA  in  the 
Washington  office. 

MR.  FARSTRUP:     I'm  Al  Farstrup,  I'm  Director  of 
Research  for  the  International  Reading  Association, 

MS.  LIEB-BRILHART:     I'm  Barbara  Lieb-Brilhart. 
I'm  a  team  leader  at  the  Laboratory  Program  and  work  with 
a  group  of  institutional  liaisons  each  of  whom  administers 
and  monitors  the  work  for  the  government  for  the 
laboratory. 

MR.  STALFORD:     I'm  Charlie  St al ford,  I'm  the  Team 
Leader  for  evaluation  in  the  Educational  Networks 
Division. 

I  want  to  make  a  short  statement  here,  partially 
to  establish  the  ground  rules,  and  partially  in  order  to 
keep  it  consistent  with  the  meeting  tomorrow  which  will 
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1  have  the  same  purpose  with  a  different  group. 

2  The  purpose  is  we  hope  to  achieve  through  this 

3  meeting  and  to  set  forth  the  ground  rules ,  both  to 

4  facilitate  its  recording  and  synthesis,  and  also  to  keep 

5  the  discussion  within  appropriate  bounds  in  that  it  is 

6  related  to  the  pending  procurement  in  the  Department  of 

7  Education. 

8  This  meeting  is  one  of  two  being  held  on  June 

9  26th  and  27th.    The  purpose  of  the  meetings  is  to  obtain 

10  the  views  of  education  associations  and  other 

11  organizations  representing  major  educational 

12  constituencies  about  the  work  and  the  future  of  the 

13  Program  of  Regional  Educational  Laboratories. 

14  The  associations  and  organizations  which  have 

15  been  invited  to  be  represented  at  this  meeting  but  who  are 

16  not  present  also  have  the  opportunity  to  submit  written 

17  statements  directly  to  OERI  regarding  the  issues  to  be 

18  discussed.    Let  me  stop  for  a  moment  and  ask,  have  any  of 

19  you  brought  any  written  statements  who  are  here?    I  don't 

20  anticipate  that.    But  the  synthesizer  wanted  to  know  that. 

21  These  two  meetings  are  not  the  only  opportunity 

22  to  provide  input  to  OERI  regarding  the  lab  recompetition. 

23  OERI  will  hold  three  open  meetings  in  July  at  which 

24  members  of  the  public  may  express  their  views  about  the 

25  lab  program  and  the  recompetition.    These  meetings  will  be 
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1  held  on  July  19th  in  Washington,  D.C.,  Kansas  City, 

2  Missouri  and  on  July  21st  in  San  Francisco.    Members  of 

3  the  public  who  wish  to  make  a  statement  to  OERI  but  who 

4  are  unable  to  attend  any  of  these  meetings  may  also  submit 

5  written  statements  directly  to  OERI,    Written  statments 

6  submitted  either  from  associations  or  organizations 

7  represented  at  these  meetings  in  June,  or  the  open 

8  meetings  in  July  should  be  submitted  to  us  by  July  21st, 

9  Details  about  these  meetings,  how  to  submit  statements  to 

10  OERI,  and  also  other  background  information  about  the  lab 

11  program  and  recompetition  are  contained  in  the  notice 

12  published  in  the  Federal  Register,  Friday  June  23rd.  A 

13  copy  of  that  notice  is  printed  in  the  Register  and  is 

14  available  at  the  back  of  this  room. 

15  The  issues  that  OERI  wishes  to  receive  views 

16  about  from  association  and  organization  representatives  in 

17  these  two  days  of  meetings  are  contained  in  the  invitation 

18  to  representatives  and  are  also  found  in  the  Federal 

19  Register  notice.    If  there  is  any  question  about  those 

20  when  ve  begin,  we  can  go  over  those  issues. 

21  The  purpose  of  these  two  meetings  is  for  OERI  to 

22  learn  the  individual  views  of  the  representatives  of  the 

23  associations  and  organizations  about  these  issues, 

24  particularly  from  the  viewpoint  of  the  constituencies  they 

25  represent.    The  purpose  is  not  to  obtain  consensus  views 
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1  of  those  present  on  any  of  these  issues, 

2  OERI  will  seriously  consider  views  expressed  here 

3  and  received  through  the  other  means  described  previously. 

4  It  does  not  mean  that  OERI  endorses  any  of  them  or  that 

5  they  will  necessarily  be  reflected  in  the  final  policy 

6  regarding  the  lab  recompetition  or  the  solicitation  of  the 

7  proposals  itself. 

8  Followirg  this  introduction  and  a  short  period 

9  for  questions  and  answers,  which  you  jnay  have  about  it,  we 

10  will  ask  association  and  organization  representatives  to 

11  comment  individually  on  the  issues  in  the  invitational 

12  letter.    You  may  also  raise  other  issues  that  Nelson 

13  mentioned  before  that  you  may  have  on  your  mind  related  to 

14  the  lab  recompetition  tha^  are  relevant  to  your 

15  constituencies • 

16  Acting  as  Chair,  I  may  ask  some  of  you  to 

17  elaborate  or  otherwise  clarify  those  ideas  as  appropriate. 

18  And,  indeed,  Barbara  Lieb-Brilhart ,  or  David  Mack,  or 

19  Nelson  may  do  the  same.    Neither  I  nor  any  other  OERI 

20  staff  who  participated  in  the  meeting  will  engage  in  any 

21  sort  of  discussion  which  has  the  appearance  or  would 

22  actually  result  in  OERI  making  an  agreement  or  negotiating 

23  policies  for  the  recompetition.    I'm  sure  you  can 

24  understand  we  do  not  want  ~  actually  be,  or  appear  to  be, 

25  making  agreements  about  the  recompetition. 
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1  Also  present  in  the  audience  this  morning  are 

2  other  staff  of  OERI  Programs  for  the  Improvement  of 

3  Practice  which  administers  the  lab  program  and  other  OERI 

4  staff  from  other  programs.     (Possibly,  I  don't  see  any 

5  right  now) .    There  is  one  staff  member  from  the  Department 

6  of  Education  in  the  Office  of  Elementary  and  Secondary 

7  Education  and  there  are  two  staff  members  now  present  from 

8  the  Congress. 

9  It's  announced  in  the  Federal  Register  the  public 

10  has  been  invited  to  attend  and  listen  to  the  discussion  of 

11  these  meetings.    The  public  will  have  an  opportunity  to 

12  present  views  about  the  lab  program  and  recompetition  at 

13  the  July  meetings.    So  there  will  not  be  an  opportunity 

14  for  the  public  to  comment  at  these  two  meetings  in  June. 

15  If  representatives  of  other  OERI  or  Department  Of 

16  Education  programs  wish  to  make  comments  about  the 

17  recompetition,  in  particular,  about  the  relationships  of 

18  the  lab  program  and  their  programs  in  the  future,  I'll 

19  recognize  them  to  make  such  comments.    I  point  that  out 

20  particularly,  perhaps,  /for  Mr.  Keller  who  is  here  from 

21  OESE  and  anyone  else  from  other  federal  programs  who  may 

22  have  some  thoughts  about  the  relationship  of  their  program 

23  as  a  departmental  matter  to  the  laboratory  program  that 

24  will  not  be  considered  public  input.    This  input  will  be 

25  accepted  in  the  spirit  of  increasing  the  communications 
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1  and  coordination  between  various  OERI  and  departmental 

2  programs . 

3  Again  the  making  of  such  statements  should  in  no 

4  way  be  interpreted  to  mean  OERI  staff  involved  in  the 

5  recompetition  endorses  or  would  necessarily  act  on  that. 

6  I  mentioned  to  you  before  that  we  will  have  a 

7  verbatim  transcript  of  this  meeting  as  well  as  a  written 

8  synthesis  of  it.    The  synthesis  of  transcripts  of  these 

9  meetings  will  oe  made  available  to  the  public  as  soon  as 

10  they're  available  which  will  be  around  mid  July. 

11  Transcripts  from  the  open  meetings  in  July,  plus  any 

12  statements  submitted  directly  to  OERI  will  also  be  made 

13  available  to  the  public. 

14  in  addition,  policy  papers  commissioned  by  OERI 

15  for  recompetition  planning  and  other  documents  listed  on 

16  the  tables  at  the  back  of  this  room  are  now  available  to 

17  the  public. 

18  We  are  making  these  documents  available  for  two 

19  purposes.    The  first  is  to  enhance  public  understanding  of 

20  the  lab  program  and  its  significance  in  the  recompetition. 

21  The  second  purpose  is  to  encourage  preparation  of  the 

22  highest  quality  proposals  as  possible  in  the  recompetition 

23  from  non incumbents  and  incumbents  alike.    We  hope  that 

24  these  documents  will  receive  wide  distribution. 

25  Those  present  today  and  anyone  else  who  makes  a 
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1  request  can  have  their  name  placed  on  an  OERI  mailing  list 

2  to  receive  any  and  all  of  these  documents,  notice  of 

3  future  events  in  the  recompetition,  the  copies  of  the 

4  solicitation  of  the  proposals  itself,  and  an  announcement 

5  of  the  outcome  of  the  recompetition.    We  are  committed  to 

6  a  free  flow  of  information  regarding  the  recompetition. 

7  We  heljfcve  that  it  is  both  in  the  public  interest  and  also 

8  the  long-term  viability  of  the  lab  program. 

9  If  there  are  any  questions  that  you  m*y  have 

10  about  the  process  or  goals  of  the  meeting,  we'll  return  to 

11  those.    We  do  want  to  express  our  appreciation  of  the 

12  staff  for  Nelson  Smith's  presence  today,  and  I  believe  to 

13  two  people  have  come  in  since  we  started.    So  let  us 

14  introduce  them. 

15  MR.  SROUFE:     I'm  Gerry  Sroufe  with  AERA. 

16  MR.  PETERS:     I'm  Iawrence  Peters  from  Select 

17  Education. 

18  MR.  BALCOME:     I'm  Steve  Balcome  with  Information 

19  Servi^s* 

20  MR.  STALFORD:    Anyone  else  come  in  that  I  didn't 

21  see?    r..  *  there  any  questions,  particularly  from  those  of 

22  you  at  the  table,  about  what  we'd  like  to  obtain  here  for 

23  our  purposes  and  how  we  should  go  about  them? 

24  I  would  like  to  ask,  again,  the  Reporter  requests 

25  that  you  speak  up.    This  room,  you  may  have  noticed,  has  a 
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1  sort  of  ambient  noise  in  it.    The  cooling  system  runs  all 

2  the  time  and  words  get  lost.    I'm  saying  that  for  my  own 

3  benefit  as  well  as  anyone  elses. 

4  I  was  going  to  ask  before  you  begin  to  restate 

5  your  name.    But  this  group,  I  think,  is  small  enough  so 

6  that  should  not  be  necessary. 

7  Well  let  us  turn  to  the  issues  and  perhaps  I'll 

8  just  restate  them  quickly  for  the  benefit  of  everyone  in 

9  the  room.    The  folks  who  are  here  and  others  who  were 

1C  invited  who  may  be  here  tomorrow  were  asked  to  comment  on 

11  the  following  four  issues  from  the  perspective  of  the 

12  constituencies  which  they  represent. 

13  What  activities  conducted  by  Regional  Educational 

14  Laboratories  have  been  most  valuable  to  your  constituency 

15  in  the  past  two  or  three  years? 

16  What  are  the  key  educational  issues  laboratories 

17  should  focus  on  in  the  future? 

18  What  kinds  of  activities  and  strategies,  for 

19  example,  synthesis  and  other  R&D  products  or  direct 

20  technical  assistance,  capacity  building,  and  so  forth, 

21  would  most  benefit  your  constituency  in  the  future? 

22  Finally,  what  form  of  laboratory  relationship  or 

23  relationships  with  your  constituency,  for  example, 

24  centralized  or  decentralized  relationships,  formal 

25  relationships,  informal,  and  I  might  add,  partnerships  or 
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1  contractual,  what  forms  of  those  relationships  would  be 

2  most  effective  to  work  with  your  constituency  in  the 

3  future? 

4  The  table  is  open  for  discussion,  and  I  hope  that 

5  we  can  obtain  views  from  each  of  you  who  are  here 

6  representing  the  different  associations.    And  as 

7  indicated,  if  we  feel  a  need  to  clarify  or  gain  some 

8  elaboration,  we'll  engage  in  that  discussion  with  you. 

9  I  add  only  one  other  note  about  the  time,  that 

10  the  meeting  is  scheduled  to  run  until  11:45.    We  are  not 

11  committed  to  that  at  all  costs.    If  we  run  out  of  things 

12  to  say  at  that  time,  we  will  stop,  of  course.    But  we  will 

13  go  as  long  as  it's  useful  to  do  so.    So  may  I  open  the 

14  table  to  reactions  and  comments  on  these  issues  or  related 

15  ones. 

16  MS.  LUCIER:    Are  we  still  talking  about  this 

17  configuration  of  labs,  this  regional  division? 

18  MR.  STALFORD:  Yes. 

19  MS.  LUCIER:    We're  actually  going  to  have  one  lab 

20  as  presently  constructed? 

21  MR.  STALFORD:  Yes. 

22  MR.  SMITH:    I  think  that  is  the  current  plan. 

23  But  I  think  we  should  take  the  position  that  everything  is 

24  open  to  discussion.    If  you  have  a  comment  about  that 

25  configuration  or  suggestion  or  would  like  to  make  a 
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1  statement  about  it,  feel  free. 

2  MR.  FARSTRUP:    After  I  received  you're  invitation 

3  I  did  some  informal  inquiry  about  these  issues ,  and  it 

4  'seems  that  this  is,  perhaps,  the  first  time  in  at  least 

5  three  or  four  years  that  our  association  had  any  formal 

6  contact  regarding  laboratories. 

7  So  I'm  concerned  when  I  ask  people,  not  only 

8  association  officials,  but  members  or  teachers  that  most 

9  people  wouldn't  be  able  to  address  either  one.    At  least  a 

10  large  number,  many  people,  wouldn't  be  able  to  address 

11  either  one  with  a  lot  of  information  about  it  because  they 

12  simply  are  not  aware  of  a  lot  of  activities  that  regional 

13  laboratories  have  been  involved  in. 

14  MR.  SMITH:    May  I  ask  a  question?  Your 

15  constituency  in  the  IRA  consists  mainly  of  whom? 

16  MR.  FARSTRUP:    The  largest  portion  of  our  members 

17  are  reading  specialists  and  classroom  building  or  district 

18  level  coordinators  that  are  reading  programs  and  language 

19  art  programs.    They're  school  district  based  people.  We 

20  also  have  about  12  percent  university.    They  would 

21  probably  be  much  more  aware  of  the  efforts  of 

22  laboratories. 

23  The  concern  that  I  have  is  related  to  one  of  the 

24  strategies  laid  out  in  the  paper,  the  indirect  service 

25  strategy,  they're  trying  to  leverage  what  the  labs  are 
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1  doing  working  with  intermediate  agencies,  and  I'd  like  to 

2  think  that  there  is  a  lot  more  to  be  done  in  that  area, 

3  IRA  in  particular. 

4  One  of  our  strengths  is  the  dissemination  area, 

5  Reading  and  Language  Arts.    Some  sort  of  working 

6  relationship  or  parternship  to  assist  in  the  dissemination 

7  process  could  be  very  hopeful,  I  may  be  wrong.    But  I'm 

8  not  aware  of  any  contracts  to  get  that  going. 

9  MR.  SMITH:    Would  you  say  that  there  have  been 

10  any  more  contacts  with  the  research  centers  than  with  the 

11  regional  labs? 

12  MR.  FARSTRUP:    Much  more  contact  with  centers 

13  than  with  the  labs.    Contact  with  center  is  fairly 

14  constant.    Naturally  the  center  involved  with  a  study  of 

15  reading  is  the  one  that  we  have  most  to  do  with.    But  the 

16  Centers  for  the  Study  of  Literature  and  Writing,  those 

17  centers  are  also  pretty  regularly  in  touch  with  the 

18  association,  and  we  receive  their  reports  and  we  have 

19  regular  discussions  about  products  that  they  produce  and 

20  we  might  disseminate.    I  can't  think  of  any  similar 

21  contact  with  the  laboratories. 

22  MR.  SMITH:    What  kind  of  relationship  would  you 

23  like  to  see  with  the  labs?    In  other  words,  for  your 

24  constituency,  being  that  they  apparently  are  not  being 

25  reached  in  the  indirect  service  strategy,  what  kinds  of 
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1  services,  what  kinds  of  goods  and  services  or  products 

2  would  you  like  to  see  coming  out  of  the  lab  and  how 

3  delivered? 

4  MR.  FARSTRUP:    I  think  the  model  that  we  followed 

5  in  working  with  the  ERIC  Centers  is  a  reasonable  one  where 

6  the  ERIC  Center  dealing  with  literacy  and  reading  and 

7  language  arts  has  worked  with  IRA  to  develop  publications, 

8  joint  publications  to  focus  on  particular  issues.    That  is 

9  one  possibility  of  the  dissemination.    Not  just  of 

10  technical  reports,  but  perhaps  the  implications  or 

11  synthesis  reports  off  some  sort. 

12  I  would  think  some  efforts  to  involve  labs  in 

13  presenting  significant  findings  and  results  through  our 

14  program  of  conferences  would  be  helpful.    Opening  up  a 

15  line  of  communications  or  having  a  contact  on  a  regular 

16  basis  with  the  labs  would  be  very  helpful. 

17  There  are  any  number  of  mechanisims  we  have  with 

18  dissemination,  ranging  all  the  way  from  our  bi-monthly 

19  news  letter  to  formal  publications  and  conferences.  I 

20  would  suggest  that  this  kind  of  relationship  is  not  just 

21  relevant  for  the  Reading  Association,  but  for  the  world  of 

22  professional  associations  in  general. 

23  MR.  STALFORD:    If  I  may  clarify,  Alan,  with 

24  regard  to  the  indirect  service  strategy  when  you  first 

25  brought  it  up,  you  could  have  been  saying  that,  perhaps, 
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that  is  not  the  way  to  reach  your  local  level  of  reading 

2 

specialists  or  you  could  apparently  —  you  are  saying  you 

3 

wish  it  was  done,  the  indirect  services  did  not 

4 

necessarily  change,  but  was  more  effective  in  working  with 

5 

your  groups? 

6 

MR.  FARSTRUP:    I'm  willing  to  accept  the  notion 

7 

that  you  leverage  or  impact  with  working  with  other 

8 

groups,  if  you  want  to  characterize  that  as  indirect 

9 

service.    I  don't  think  the  strategy  has  worked  up  to  now. 

10 

Perhaps  it  works  better  at  the  pel icy  maker  and 

11 

administrative  levels. 

12 

One  of  the  concerns  that  seems  to  be  arising  from 

13 

our  constituents  is  that  often  truth  is  handed  down  from 

14 

on  high,  rather  than  being  allowed  to  bubble  up  from  the 

15 

classroom  and  to  be  disseminated  outward.    Many  of  our 

16 

members  are  asking  actively  to  be  involved  in  research 

17 

design  and  decision  making  based  on  their  day-^.o-day 

18 

classroom  experience  or  their  experience  in  managing 

19 

reading  programs  within  school  districts  of  all  different 

20 

sizes.    This  kind  of  comment  is  being  made  in 

21 

relationship,  not  only  to  the  labs,  but  to  the  centers  as 

22 

well. 

23 

MR.  MACK:    Not  during  this  performance  period  of 

24 

the  labs,  but  previously,  the  laboratories  did  it  through 

25 

the  Research  Within  Reach  of  the  RDIS,   (Note:  RDIS  refers 
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1  to  the  Research  and  Development  Interpret  ivr,  service) , 

2  project  did  both  the  elementary  and  secondary  thing  and 

3  worked  with  IRA  on  that  — 

4  MR.  FARSTRUP:    We  have  had  that  case  and  that  has 

5  been  very  successful. 

6  MR.  MACK:    That  was  in  the  past? 

7  MR.  FARSTRUP:  Yes. 

8  MR.  MACK:    More  activities  like  that  would  be  in 

9  line  with  the  sort  of  thing  that  you  are  talking  about? 

10  MR.  FARSTRUP:    Yes.    That  has  been  a  very 

11  successful  cooperative  effort,  and  it's  one  that,  I  think, 

12  provides  a  good  model  for  future  work.    I  think  that  has 

13  been  the  main  example  of  cooperative  efforts  that  we've 

14  had,  at  least  in  the  time  that  I've  been  in  the  IRA  which 

15  is  about  four  years  now. 

16  MS.  LIEB-BRILHART:    You  mentioned  that  ERIC  was 

17  doing  joint  publications  with  you.    What  role  would  you 

18  see  that  would  be  different  from  the  labs  than  with  the 

19  ERIC  program,  if  any? 

20  MR.  FARSTRUP:    I  think  it  would  be  very  similar. 

21  There  needs  to  be  a  mechanism  for  jointly  selecting  kinds 

22  of  topics  and  information  that  is  disseminated.  And 

23  naturally,  not  everything  that  the  labs  produce  would  be 

24  appropriate  for  associations  to  deal  with.    I  think  there 

25  is  a  wide  spectrum  of  subject  matter  groups  and 
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1  professional  groups  out  there  that  could  tap  into  the 

2  various  levels  of  information  in  different  ways.  There 

3  have  been  some  successes.    But  I  think,  by  and  large, 

4  there  needs  to  be  a  greater  effort  in  that  area. 

5  MR.  SMITH:    When  your  constituents  work  with  the 

6  ERIC  system  or  with  the  centers,  they  work  with  any 

7  centers  from  around  the  country  or  the  clearing  houses 

8  that  are  appropriate  to  the  subject  matter,  right? 

9  MR.  FARSTRUP:  Yes. 

10  MR.  SMITH:    Do  you  see  any  distinctly  regional 

11  quality  to  kinds  of  things  that  your  constituents  might 

12  need  from  the  lab  system? 

13  MR.  FARSTRUP:    Quite  frankly,  no.     I  think  it 

14  varies  with  the  individual  things  that  the  labs  are  doing, 

15  the  topics  that  have  been  taken  up.    At  the  present  time, 

16  a  lot  of  interest  is  being  focused  on  issues  such  as 

17  whether  student-centered  curriculum  changes  are  more 

18  effective  than  the  more  previous  model  of 

19  curriculum-centered  instruction. 

20  We're  dealing  with  literature  based  construction. 

21  Integrated  language  arts  is  a  large  movement  in  our 

22  profession  right  now,  and  we're  coming  out  of  a  time  when 

23  there  was  much  more  attention  to  curriculum-driven 

24  instruction  rather  than  sort  of  a  child-centered 

25  instruction. 
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1  When  you  talk  about  needs  for  dissemination, 

2  those  labs  that  are  working  in  that  general  area  would  be 

3  a  particular  interest  to  our  constituency  to  look  at  the 

4  effects  of  growing  implementation  and  literature 

5  instruction,  for  example. 

6  MR.  STALFORD:    Can  you  explain,  at  least  for  me, 

7  briefly,  the  distinction  between  curriculum-driven  and 

8  child-centered  instruction? 

9  MR.  FARSTRUP:    It's  put  in  terms,  if  you  want  to 

10  put  it  in  extremes,  in  the  early  reading  instruction.  For 

11  example,  you  have  one  perspective  that  deals  with  skills, 

12  hierarchies,  perhaps,  way  down  to  the  level  of  individual 

13  phonics  skills  and  that  are  prescribed  by  the  curriculum. 

14  And  the  child  follows  that  curriculum,  rather  than  dealing 

15  on  a  more  wholistic  scale  or  a  different  level  of  trying 

16  to  assess  what  the  child  needs  and  letting  that  dictate 

17  where  they're  headed  instructional ly.    It's  the  focus  on  a 

18  child  as  a  source  of  information  about  what  ought  to  be 

19  taught  versus  the  focus  on  a  curriculum  document  of  some 

20  sort  as  what  ought  to  be  taught,  that  is  one  way  to  put 

21  it. 

22  I  think  that  issue  is  bubbling  in  more  than  one 

23  subject  matter,  not  just  in  reading.    There  are  a  lot  of 

24  statements  being  made,  a  lot  of  positions  being  taken 

25  without  a  whole  lot  of  hard  information  research  evidence 
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1  one  way  or  the  other. 

2  MR.  SELDEN:    I'm  Ramsay  Selden  with  the  the  Chief 

3  State  School  Officers.    I  am  sort  of  troubled  about  the 

4  fact  that  the  laboratories  have  identified  Chief  State 

5  School  Officers  as  one  of  their  pri-  ry  constituents,  and 

6  I've  heard  lab  directors  say  that  the  first  consideration 

7  that  goes  through  their  mind  is  how  and  what  they're  doing 

8  in  the  interest  of  the  chiefs  in  the  region.    Yet  on  the 

9  other  hand,  I'm  not  sure  that  there  is  that  cross  between 

10  all  of  the  laboratories. 

11  There  are  a  lot  of  activities  that  Chief  State 

12  School  Officers  or  their  staff  would  be  able  to  point  to 

13  in  the  labs  that  they  know  about  that  they  would  be  able 

14  to  say  has  been  particularly  helpful.    That  I  think  varies 

15  a  lot  among  the  regions.    I  think  in  some  cases  the 

16  laboratory  program  is  very  well-known  and  appreciated  by 

17  the  states  in  that  region. 

18  I  think  in  other  regions,  the  laboratory  program 

19  is  not  very  well-known  and  is  not  perceived  as  being 

20  particularly  useful  to  that  region.    It's  a  highly 

21  variable,  I  think,  phenomenon.    I  think  what  it  means  is 

22  in  cases  where  the  laboratory  program  has  in  one  way  or 

23  the  other  developed  to  respond  to  the  specific  needs  that 

24  the  states  in  an  area  experience,  that's  where  it  seems 

25  it's  being  useful. 
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1  The  general  services,  the  concept  of  generic 

2  services  that  are  provided  through  a  regional  laboratory, 

3  my  sense  is,  that  it  hasn't  been  particularly  valuable  to 

4  states,  but  the  more  specific  services  have.    For  example, 

5  the  Northwestern  —  I  shouldn't  name  names.    But  in  the 

6  Northwest  there  has  been  a  fair  amount  of  activity  by  the 

7  lab  helping  with  educational  technology  and  distance 

8  learning.    That  is  a  big  need,  especially  in  Alaska. 

9  My  perception  is  that  in  the  Southeast,  the 

10  laboratory  there  has,  the  program  has  been  devuloped  with 

11  a  lot  of  interaction  with  the  state  agencies  and  there  is 

12  a  lot  of  satisfaction  with  the  issues  that  they're  dealing 

13  with  which  have  grown  out  of  the  Southeastern  states' 

14  needs . 

15  But,  for  example,  in  the  Northeast,  there  are 

16  seven  states  there  which  have  formed  a  regional  project  on 

17  teacher  supply  and  demand.    They've  done  it  on  their  own, 

18  pretty  much  independent  of  the  laboratory  because  they 

19  have  wanted  to  look  at  the  interaction.    A  teacher  can 

20  live  in  southern  New  Hampshire  and  teach  in  three  or  four 

21  states  because  of  the  commuting  proximity. 

22  So  if  Maine  or  New  Hampshire  creates  incentives 

23  for  teachers,  they  can  draw  teachers  from  Vermont  and 

24  Massachusetts  very  quickly  before  anybody  realizes  what's 

25  happening.    So  those  statas  are  concerned  about  a  regional 
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1  model  for  teacher  supply  and  demand.    They've  been  working 

2  at  an  institute  at  the  University  of  Massachusetts  to 

3  develop  that  model  and  analyze  what's  going  on  there. 

4  I  guess  my  recommendations  would  be  that  the 

5  activities  that  the  laboratories  take  on  which  are  valued 

6  by  states  are  very  specific  and  immediate  in  their  utility 

7  to  the  states,  and  that  the  concept  of  sort  of  general 

8  services  th»t  each  regional  institution  can  provide  that 

9  would  be  perceived  as  useful  to  states  is  very  tricky  and 

10  that  I  would  encourage  more  tailoring  of  activities  to 

11  meet  what  states  feel  are  their  needs,  rather  than  trying 

12  to  come  up  with  a  program  that  provides  general  service 

13  that  all  states  would  value  because  I  don't  think  that  has 

14  worked  particularly  well  in  the  past. 

15  I  would  encourage,  in  terms  of  the  future, 

16  ranging  from  everything  from  the  regional  break-out  to  the 

17  mission  of  these  institutions  the  way  they're  funded,  a 

18  really  clean-slate  approach.    I  think  we  have  an 

19  opportunity  to  rethink  this  from  the  ground  up  and  that 

20  that  really  ought  to  happen.    I  think  it  would  be  a  shame 

21  to  hold  ourselves  to  movement  at  the  margins  if  more 

22  radical  fundamental  changes  are  required. 

23  MS.  LIEB-BRILHART :    As  you  know,  chiefs  serve  on 

24  laboratory  governing  boards,  and  one  of  their  roles  is  to 

25  help  shape  and  direct  the  work  of  the  lab  in  relation  to 
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1  the  needs  of  the  regions.    Do  you  have  any  feeling  about 

2  how  well  they  think  they're  doing,  that  how  well  that  role 

3  is  working  on  governing  the  boards? 

4  MR.  SELDEN:    I  think  in  some  regions  it's 

5  working.    I  think  in  the  Southeastern  Region,  and  maybe 

6  that  is  because  that  laboratory  has  evolved  more  from 

7  scratch  much  more  recently  than  the  other  institutions, 

8  but  I  think  that  if  you  ask  the  chiefs  in  the  Southeast, 

9  if  you  asked  all  the  chiefs,  like  I  assume  you  have,  my 

10  guess  is  that  you  would  find  the  chiefs  in  the  Southeast 

11  feel  that  the  program  in  the  Southeastern  Lab  is  more 

12  responsive  to  what  they  as  a  cluster  of  states  need. 

13  The  Southeastern  states  have  fairly  vivid  or 

14  distinct  needs  that  are  also  coherent.  They're 

15  homogeneous  within  that  region.    They've  got  tremendous 

16  basic  educational  improvement  needs,  limited  resources,  a 

17  lot  of  equity  problems,  a  lot  of  things  like  rural  school 

18  problems.  And  I  think  that  argues  for  a  program  that,  you 
1*  know,  responds  to  those  needs,  you  can  probably  make  a  lot 

20  of  states  happy. 

21  I  don't  know  whether  the  problem  is  that 

22  activities  in  other  labs  in  other  regions  have  been  more 

23  in  place  and  the  states  haven't  been  able  to  redirect  or 

24  to  determine  what  they  do,  or  if  the  needs  are  less 

25  distinct  or  less  homogeneous  in  other  regions.    But  I 
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1  don't  see  that  kind  of  thing. 

2  I  was  at  a  meeting,  on  this  one  I  won't  name 

3  names,  but  I  was  in  a  state  where  there  is  very  specific 

4  activity  going  on  to  develop  assessment  repibrt  cards  in 

5  the  schools.    And  there  was  a  very  sincere  conscientious 

6  attempt  by  the  laboratory  to  assist  that  and  it  really  — 

7  the  lab  was  not  perceived  as  being  able  to  offer  the  state 

8  anything  that  was  particularly  useful,  and  they  were 

9  virtually  asked  not  to  bother. 

10  That  is  a  very  strong  issue,  a  hot  issue  that  a 

11  lot  of  states  are  trying  to  deal  with  and  why  the  labs 

12  were  not  perceived  as  having  the  capabilities  to  help 

13  states  deal  with  that  problem    —  it  bothers  me,  at  least 

14  in  that  particular  instance. 

15  MR.  SMITH:    Can  I  ask  you  to  go  back  to  two 

16  instances  you  cited  about  very  specific,  clear  needs,  the 

17  one  in  New  Hampshire  with  teachers  across  the  border  and 

18  the  Southeast  Region.    It  looks  to  me  like  those  are  very 

19  clearly  defined  needs  that  encompass  certain  portions  of 

20  at  least  those  two  regions. 

21  Do  you  think  that  the  success  of  the  lab  boards 

22  in  responding  to  regional  needs  is  related  to  the 

23  s;  «*cif icity  of  those  needs  as  regional  needs?    Is  there  a 

24  match  that  is  appropriate  to  you  between  the  configuration 

25  as  we  now  have  it  and  the  actual  needs  that  those  boards 
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1  are  governing,  trying  to  respond  to,  rather? 

2  MR.  SELDEN:    I  think  when  states  are  satisfied 

3  with  the  services  that  they  are  getting  from  the  labs, 

4  because  the  services  are  very  distinct  and  meet  what  they 

5  perceive  to  be  their  most  important  or  most  urgent  needs 

6  rather  than  being  a  generic  service  that  is  built  into  all 

7  of  the  labs  which  states  happen  to  feel  is  useful,  I  don't 

8  think  that  the  latter  work  has  much  more  than  the  former. 

9  I  think  that  is  because  states  have  very  specific 

10  agendas.    They  are  under  a  lot  of  pressure  to  do  very 

11  specific  things,  and  if  a  laboratory  is  able  to  help, 

12  they'll  be  appreciated,  if  they're  not,  they  are  going  to 

13  have  to  do  those  things  on  their  own. 

14  MR.  SMITH:    I  guess  my  question  is  that,  indeed, 

15  every  state  does  have  a  pretty  specific  agenda.  Governors 

16  get  elected  on  the  basis  of  reforming  an  education  system 

17  and  whatnot.    But  the  agenda  of  a  region  is  much  less 

18  clear.    Do  you  think  that  there  are  some  areas,  perhaps, 

19  that  just  don't  have  an  agenda,  there  are  some  regions 

20  that  don't  really  have  an  agenda  as  a  region? 

21  MR.  SELDEN:    I  suspect  that  there  would  be  some 

22  fairly  common  needs  that  would  mitigate  toward  a  common 

23  agenda  in  most  regions  and  that  those  would  be  combined 

24  with  fairly  distinct  states,  individual  state  needs,  so 

25  that,  you  know,  there  are  three  things  we're  talking 
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1  about . 

2  General  needs  you  can  build  into  every  laboratory 

3  that  every  state  wants,  that  I  don't  think  are  very 

4  successful,  regional  needs  that  are  coherent  and  states  in 

5  the  region  feel,  and  than  individual  state  needs.    71  think 

6  in  each  region  what  we're  talking  about  is  some 

7  combination  of  regional  and  state-specific  needs  and  that 

8  the  success  of  the  lab  —  the  extent  to  which  the  lab  is 

9  perceived  by  the  states  as  meeting  their  needs  —  the  lab 

10  would  be  meeting  a  combination  of  regional  and  individual 

11  needs. 

12  I  think  that  in  some  regions,  the  regional  needs 

13  may  be  more  clear,  they  may  be  stronger,  they  may  be 

14  easier  to  identify  than  in  other  regions.    I  think  the 

15  Southeast  and  Northeast,  because  of  the  geography  are, 

16  perhaps,  examples  of  that.    Maybe  upper  Midwest  and  the 

17  Rocky  Mountains  and  Plains  areas  it's  less  easy  to  get  a 

18  handle  on  what  their  regional  priorities  are. 

19  MR.  STALFORD:    Ramsay,  as  you  probably  know,  the 

20  labs  now  have  as  a  task  in  their  current  contracts  one  of 

21  four  programmatic  tasks,  to  provide  assistance  to  state 

22  decision  makers,  in  part,  I  presume,  on  policy  related 

23  issues.    Are  you  saying  that  the  need  for  that  will  vary 

24  by  state?    That  is,  perhaps,  I  think  you're  saying  that 

25  some  states  may  need  assistance  more  than  others.    Do  you 
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1  have  any  views  about  that  cross-the-board  requirement  to 

2  assist  state  decision  makers  that  is  contained  in  the  lab 

3  contracts? 

4  MR.  SELDEN:    I  think  that  where  a  chief  state 

5  school  officer  as  a  decision  maker  perceives  a  need  for 

6  assistance,  is  going  to  —  I  would  think  that  they  would 

7  be  almost  completely  unique  in  each  state  and  that  for  the 

8  laboratory  working  with  eight  or  ten  states,  they 

9  essentially  would  be  working  with  the  ten  case  profiles  of 

10  what  that  chief  imagines  himself  or  herself  to  need  help 

11  with. 

12  Secondly,  even  the  common  things  that  they  need 

13  help  with,  they  need  really  good  expertise  on  those 

14  issues.    This  whole  business  of  school  report  cards  that  I 

15  brought  up  earlier,  I  think,  is  just  a  perfect  example. 

16  They're  are  three  or  four  national  experts  that  can  help  a 

17  state  think  their  way  through  those  issues.    How  you 

18  provide  that  expertise  to  a  state  through  a  regional 

19  laboratory,  I  think  is  by  referral  but  not  by  trying  to 

20  create  people  who  are  specialists  in  an  area  in  the 

21  regional  lab.    I  think  that  is  why  it  didn't  work  in  this 

22  one  instance  is  the  person  from  the  regional  lab  who  was 

23  willing  to  help  simply  wasn't  knowledgable  enough  about 

24  the  issues  that  the  chief  needed  help  with. 

25  So  I  guess  that  would  argue  for  labs  on  some  kind 
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1  of  a  brokering  role  and  putting  the  state  people  in  touch 

2  with  national  experts  who  can  provide  this  assistance. 

3  MS.  LIEB-BRILHART:    Ramsay,  on  the  instance, 

4  using  the  example  because  it's  a  good  one,  of  the 

5  Northeast  what  they're  calling  the  common  market  approach 

6  on  teacher  certification,  do  you  think  that  had  those 

7  chiefs  not  all  been  together  on  the  lab  board,  had  the  lab 

8  not  convened  them  and  provided  information,  do  you  think 

9  they  would  have  gotten  together  on  their  own  without  this 

10  outside  agent  to  convene  and  to  provide  information  for 

11  that  purpose? 

12  MR.  SELDEN:    I  think  so  because  I  think  two  or 

13  three  of  the  chiefs  and  their  research  and  testing 

14  directors  felt  the  need.    I  think  Massachusetts  ~  I'm 

15  sorry,  Connecticut,  New  York,  and  Vermont  would  have  come 

16  up  with  the  mechanism  for  doing  that  if  the  lab  board  had 

17  not  provided  the  opportunity.    My  sense  is  that 

18  Connecticut  pushed  it  and  that  they  would  have  used  some 

19  other  mechanism. 

20  MR.  SMITH:    Your  suggestion  about  the  lab 

21  brokering  role  is  interesting.    If  the  labs  are 

22  individually  all  trying  to  broker  the  available  experts 

23  there  are  to  certain  states,  is  there  any  advantage  to 

24  doing  that  on  a  regional  basis  or  if  you're  talking  about 

25  subject  matter  expertise  that  crosses  regional  boundaries 
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1  could  that  be  better  handled  out  of  one  central  brokerage 

2  do  you  think? 

3  MR*  SELDEN :    There  are  some  things  which  I  think 

4  some  topics  —  and  I've  talked  with  you,  Nelson,  and  with 

5  Charlie  and  David  about  this.    But  there  are  some 

6  educational  improvement  brokering  activities  where  the 

7  national  expertise  is  so  focused  that  I  think  you  have  to 

8  have,  you've  got  to  have  the  state,  the  local  people  put 

9  in  touch  with  national  experts  somehow.    Whether  a 

10  regional  laboratory  can  serve  as  a  link  in  that  process,  I 

11  don't  know. 

12  But  I'm  utterly  convinced  that  if  a  school 

13  district  is  trying  to  improve  reading  comprehension  for 

14  disadvantaged  low  achievers,  they  should  interact  with 

15  experts  at  a  place  like  the  Center  for  the  Study  of 

16  Reading  or  with  members  of  International  Reading 

17  Association  who  are  knowledgeable  about  those  issues. 

18  But  those  are  sort  of  two  national  repositories 

19  of  expertise,  and  I  think  they  ought  to  be  put  in  touch 

20  with  those  repositories  of  expertise  rather  than  having 

21  regional  laboratory  staff  trying  to  solve  that  problem  for 

22  them  because  I  don't  think  they  are  going  to  get  deep 

23  enough  help  with  what  they  are  trying  to  do  through  the 

24  regional  institution. 

25  On  the  other  hand,  I  think  there  are  some  things 
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1  that  can  be  done.    In  the  SEDL  region  right  now  Arkansas 

2  is  moving  into  this  business  of  school  report  cards  and 

3  school  incentives  and  a  person  at  SEDL  is  helping  Arkansas 

4  organize  a  meeting  on  this.    That  seems  to  be  working 

5  really  well. 

6  There  are  functions  that  I  think  are  fairly 

7  efficient  to  break  down  on  &  regional  basis  because  you 

8  break  down  the  economy  of  scale.    Ford  r.otor  company 

9  provides  customer  service  on  a  regional  basis  because  it's 

10  easier  to  cover  five  states  than  the  whole  country,  you 

11  know,  I  have  one  office  in  Dearborn  that  tries  to  serve 

12  the  whole  country. 

13  MR.  SROUFE:    Ramsay,  let  me  interject  to  this 

14  because  it  relates  to  something  Nelson  said  before  also 

15  about  the  regional  idea.     It's  true  that  Ford  does  that. 

16  But  it's  also  true  that  they  do  that  based  on  experience 

17  of  where  they  need  the  help  and  where  that  system  makes 

18  sense.    They  don't  just  divide  up  the  world  on  a  map  and 

19  say  these  are  the  regions,  and  I  was  thinking  about  the 

20  park  across  the  street  here  by  the  train  station,  there  is 

21  a  path  that  runs  through  over  toward  the  Capitol.  That 

22  path  wasn't  put  there  in  L'Enfant's  plan.     It  was  put 

23  there  because  that  is  where  people  walk. 

24  What  we've  got  is  a  system  that  says  this  is  hov 

25  we  divide  the  world  up  and  now  how  can  we  make  this 
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1  rational?    It  isn't  rational.    There  is  nothing  in  this 

2  country  that  is  regional  except,  I  think,  the  Tennessee 

3  Valley,  and  it  has  a  river  that  runs  through  it. 

4  So  I  get  a  little  uneasy  about  saying,  if  we  put 

5  the  chiefs  on  the  governing  board,  then  they'll  buy  into  a 

6  system.    I  think  it's  well  intended  people  trying  to  make 

7  a  system  work  that  is  20  years  old  and  we  ought  to  be 

8  trying  to  take,  to  the  best  we  can,  experience,  data-based 

9  experience  on  what  we  have  experienced  in  the  last  20 

10  years  and  it  seems  to  me  that  there  are  very  few  regional 

11  problems. 

12  The  other  thing,  and  I'll  be  done  for  awhile,  the 

13  concept  overlooks  technology  entirely.    I  think  that  is 

14  fair  because  20  years  ago  we  didn't  have  much  technology. 

15  But  anything  that  is  based  on  having  people  get  together 

16  face  to  face  because  they  can  drive  a  shorter  distance 

17  seems  to  me  to  be  an  outmoded  concept  at  this  point,  and  I 

18  would  think  we  can  say  maybe  there  ought  to  be  these 

19  things  located  in  these  areas. 

20  But  let's  put  one  then  in  the  Southeast  or 

21  Southwest,  wherever  it  makes  sense,  say  that  is  the  model 

22  that  works  well  there,  it  may  not  work  well  in  other 

23  places.    You  certainly  can't  expect  to  get  the  kind  of 

24  expertise  that  you're  asking  Ramsay  to  verify  in  each  of 

25  those  labs  because  the  mission  is  so  vague. 
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1  MR.  SELDEN:    My  example  of  what  SEDL  is  doing 

2  with  Arkansas,  there  is  no  regional  reason  for  that.  They 

3  could  be  doing  that  efficiently  if  they  were  working  with 

4  the  first  ten  states  in  the  alphabet  instead  of  the  ten 

5  states  around  Austin,  except  long  distance  charges  may  be 

6  smaller. 

7  MR.  SMITH:    Can  we  turn  it  around  the  other  way? 

8  Since  you  mentioned  Arkansas  asking  for  this  help  from  the 

9  regional  end,  can  you  comment  on  the  ability  of  the  states 

10  themselves  these  days  to  do  some  of  the  things  for  which 

11  the  labs  were  set  up  25  years  ago.    For  example,  finding 

12  expertise  like  that,  setting  up  conferences.    The  states 

13  it  seems  to  me  are  in  a  much  different  posture  from  where 

14  they  were  originally,  and  some  states  have  developed  lots 

15  of  capacity  and  others  have  not.    Could  you  address  the 

16  ability  of  the  states  to  do  some  of  those  functions  now? 

17  MR.  SELDEN:    Some  of  them,  yes.     I  think  the 

18  states  are  better  staffed  than  they  were  20  years  ago. 

19  But  I  think  it's  still  very  uneven.    There  are  some  states 

20  that  have  very  good  staff  in  some  areas.    There  is  no 

21  state  that  I  would  say  has  really  adequate,  professional 

22  staff  in  every  area  from  assessment  to  curriculum,  to 

23  evaluation. 

24  My  experience  from  working  with  state  agencies  is 

25  that  there  are  six  or  eight  states  that  have  excellent 
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1  assessment  evaluation  staff s,  another  ten  or  twelve  that 

2  have  very  good  curriculum  approval  and  are  capable  of 

3  developing  curriculum  objectives.    But  that  even  the  big 

4  sophisticated  state  agencies  in  an  area  like  that  don't 

5  necessarily  have  strength  across  the  board.    The  biggest 

6  state  agencies  like  California  and  New  York  come  closest 

7  but  they  still  are  very  thin  in  terms  of  expertise  in  some 

8  areas . 

9  MR.  SMITH:    So  even  within  a  region,  you  may  have 

10  six  or  eight  states  that  have  very  different  abilities  in 

11  areas  that  might  cut  across  all  those  states  like 

12  assessment,  for  example? 

13  MR.  SELDEN:    I've  done  some  work  with  Louisiana. 

14  Louisiana  happens  to  have,  just  because  of  history,  some 

15  good  assessment  and  evaluation  people,  two  or  three  Ph.D's 

16  xn  research  and  evaluation  in  state  agencies.    But  that  is 

17  just  happenstance,  they  don't  have  that  kind  of  expertise 

18  in  Arkansas. 

19  There  is  one  other  thing  that  you  touched  on, 

20  Nelson,  and  I'd  like  to  kind  of  pick  up  on  it  and  that  is 

21  where  you  locate  this  brokering  function  because  —  I 

22  guess  I  want  to  finish  on  two  points  from  our  perspective. 

23  One  is  I  have  observed  that  the  R&D  Utilization  Service, 

24  the  concept  of  distilling  and  synthesizing  what  is  known, 

25  what  works  in  a  given  area,  getting  that  around  is  useful 
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1  up  to  a  point.    But  that  generally,  unless  a  school  says 

2  they've  got  a  general  reading  problem  in  a  school  district 

3  and  research  within  the  region  on  reading  can  kind  of  help 

4  them  narrow  things  down  and  decide  where  their  specific 

5  problem  is  and  what  resources  they  want  to  try  to  obtain 

6  in  order  to  deal  with  that  problem;  usually  their  felt 

7  need  or  their  perceived  need  is  more  specific  than  a 

8  general  synthesis  or  summary  research  can  meet.    My  sense 

9  was  that  when  people  were  driving  around  in  the  R&D 

10  Utilization  Service  with  these  boxes  of  research  within 

11  reach  in  the  trunk  of  their  car  there  were  people  with 

12  answers  to  questions  that  weren't  really  being  asked;  and 

13  that  instead,  I  don't  know  how  much  the  agricultural  model 

14  applies  to  education,  but  I  think  some  adaptation  of  a 

15  model  where  there  is  a  group  of  professionals  whose  job  it 

16  is  to  circulate  among  schools  or  districts  within  a  state 

17  and  to  identify  what  problems  people  are  trying  to  deal 

18  with. 

19  is  it  reading  comprehension  among  at-risk 

20  traditionally  low  achieving  kids  in  school  district  X  or 

21  schools  district  Y?    If  they  hear  that  is  the  problem, 

22  having  people  who  know  who  to  put  them  in  touch  with  in 

23  order  to  try  get  help  with  that  problem,  or  who  else  is 

24  trying  to  deal  with  that  problem  that  they  may  have 

25  visited  a  week  and  a  half  earlier  who  has  got  a  very 
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1  successful  approach. 

2  I  think  there  is  a  key  here  of  tuning  into  what 

3  the  local  district  or  school's  problem  and  goal  is  and 

4  trying  to  connect  them  with  a  source  of  expertise  or 

5  information  or  a  model  that  they  can  apply.     I  don't  see 

6  that  going  on.    That  can  be  organized    on  a  regional 

7  basis,  on  a  state  state  basis,  or  some  other  basis.  But, 

8  personally,  I'd  like  to  see  people  in  state  education 

9  agencies  performing  that  kind  of  function. 

10  MR.  SMITH:    That  also  sounds  like  a  very  direct 

11  service  strategy. 

12  MR.  SELDEN:     Yes.     I've  got  a  lot  of  questions 

13  about  indirect  strategies.    I  can  see  a  lot  of  reasons  why 

14  they  wouldn't  work. 

15  The  other  point  I'll  make,  and  that  is,  our 

16  executive  director  has  testified  to  this  effect,  and  I 

17  need  to  make  a  point  here  today  and  it  gets  back  to  my 

18  opening  observation,  is  that  when  the  states  perceive  a 

19  laboratory  to  do  something  useful,  it's  because  it  meets 

20  the  state's  individual  need.    And  Gordon  has  argued  that 

21  the  way  in  which  the  laboratory  program  is  structured,  it 

22  should  include  some  kind  of  funding  structure  or  other 

23  mechanism  so  that  the  laboratory  program  can  respond  to 

24  individual  state  needs. 

25  He's  talked  about  having  a  set-aside  so  that 
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1  states  can  draw  on  an  allocation  of  resources  to  meet 

2  their  needs  and  that  the  laboratory  could  be  asked  to  do 

3  that  or  that  it  might  actually  be  resources  that  are 

4  available  to  the  state  that  the  laboratory  or  other 

5  providers  can  use  in  order  to  meet  the  states'  needs.  But 

6  let's  say,  for  example,  that  Arkansas  does  want  to  move 

7  into  school  report  cards  and  that  they've  got  an 

8  allocation  of  X,  they  could  use  part  of  that  allocation  to 

9  get  a  consultation  on  school  report  cards  or  to  have 

10  somebody  come  in  and  give  them  a  plan  or  to  do  some 

11  research  on  how  school  report  cards  affect  performance 
\z  among  local  schools  on  a  pilot-test  basis. 

13  The  idea  is  that  is  what  they  need  and  that  they 

14  should  have  some  resources  to  be  able  to  pursue  that.  I 

15  think  if  that  set-aside  were  applicable,  to  not  just  the 

16  labs,  but  other  providers,  that  would  help  introduce  some 

17  market  competition  among  the  providers  for  these  services. 

18  MR.  STALFORD:    Could  you  explain  what  you  mean  by 

19  applicable  to  other  providers? 

20  MR.  SELDEN :    Lets  say  Arkansas  has  $28,000 

21  allocated  to  them.    That  money  can  either  be  spent  at  a 

22  laboratory  or  it  can  be  spent  at  a  university  or  a  profit 

23  or  nonprofit  research  institute  that  can  do  the  work. 

24  MR.  FARSTRUP:    I'd  like  to  raise  a  related  point 

25  that  may  be  directly  the  same  thing  in  that  the  amount  of 
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1  funding  available  for  independent  field-initiated  projects 

2  and  studies  has  really  dwindled  badly,  traumatically,  in 

3  the  last  several  years  and  that  has  removed  kind  of  a 

4  market  force,  the  kind  of  thing  that  Ramsay  is  talking 

5  about . 

6  If  you  had  more  resources  available  through 

7  whatever  mechanism,  through  a  set-aside  at  the  laboratory 

8  level  or  some  kind  of  allocation  to  the  states  or  more 

9  competitively  the  federa]  level,  it  might  help  establish 

10  the  worn  out  grass  paths  that  we  heard  mentioned  before  so 

11  that  we  would  know  what  the  streams  of  need  were  through 

12  the  competitive  process  so  that  as  needs  arise  the 

13  inquiries  come,  the  projects  are  proposed.    Perhaps  the 

14  laboratory  function  can  be  one  of  streamlining  that 

15  process  so  that  it  doesn't  have  to  be  a  long  wait  until  a 

16  decision  can  be  made. 

17  But  I  really  do  think  it's  important  to  kind  of 

18  do  a  cost  effectiveness  analysis  here  and  say  is  the  money 

19  being  spent  on  the  structures,  the  administrative 

20  structures  on  all  that  the  labs  represent,  being  spent  as 

21  well  as  it  can  and  what  effect  does  that  have  on  field 

22  initiated,  independent;  studies  and  the  availability  of 

23  funds  for  those  kinds  of  activities. 

24  MR.  SELDEN:    I  think  that  what  Alan  is  saying 

25  would  help  resolve  sort  of  a  chronic  or  endemic  dilemma 
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1  with  the  labs,  and  that  is  what  you  do  with  a  place  like 

2  the  Northwest  Lab  that  has  this  real  strength  in  an  area 

3  like  performance  testing. 

4  The  Education  Department,  OERI,  has  not  known 

5  what  to  do  about  that  because  the  labs  are  supposed  to  be 

6  kind  of  cookie  cutters,  they're  not  supposed  to  develop  a 

7  lot  of  research  or  provide  research  expertise  in  a 

8  particular  area. 

9  And  I  remember  the  Department  went  through  one 

10  phase  in  the  recompetition  where  there  was  a  lot  of 

11  thought  given  to  trying  to  discourage  work,  the  idea  was 

12  that  if  you  got  the  kind  of  special  expertise  that  belongs 

13  in  the  university  but  it  detracts  somehow  from  the 

14  laboratories'  function.    I  think  that  recently  the 

15  Northwest  Lab  just  completed  a  contract  with  California  to 

16  help  develop  performance  teacher  assessment.  California 

17  went  tu  the  Northwest  Lab  to  get  that  work  done  and  their 

18  own  because  Northwest  had  expertise  and  they  wanted  them 

19  to  do  it. 

20  I  think  if  you  had  this  allocation  where  states 

21  had  funds  available  to  them  to  meet  these  needs,  it  would 

22  allow  special  deep  levels  of  expertise  like  that  to  emerge 

23  at  laboratories  and  people  could  go  to  one  laboratory  from 

24  all  over  the  country  in  order  to  get  that  if  that  is  what 

25  they  want. 
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1  MS.  LIEB-BRILHART:     Did  you  mean  the  Far  West 

2  Lab,  just  for  the  record? 

3  MR.  SELDEN:    No,  I  did  mean  the  Northwest. 

4  MS.  LIEB-BRILHART:     I  just  wanted  to  make  a 

5  comment  and  ask  a  question  from  anybody  who  wants  to 

6  answer  it.    There  is  some  applied  research,  you're  quite 

7  right.    The  amount  or  the  portion  of  the  allocation  is 

8  less  thar  some  other  tasks  the  labs  are  doing.    They  are 

9  doing  some  applied  research  at  the  local  level,  for 

10  example,  the  Far  West  Lab,  which  developed  some  strategies 

11  for  training  mentor  teachers  and  then  some  products  which 

12  are  being  nationally  disseminated.    So  it  worked  for 

13  development  and  then  dissemination. 

14  We've  heard  a  number  of  tasks  that  some  people 

15  thought  were  appropriate  for  labs  or  that  they  might  be 

16  doing  synthesis,  maybe  more  applied  research,  maybe  more 

17  policy  help  to  the  chiefs,  there  is  a  whole  array  here. 
13  If  you  had  $2  million  a  lab  a  year  to  serve  a 

19  seven  or  eight  state  region,  where  would  you  put  the 

20  emphasis  on  the  functions  that  they  should  perform  from 

21  your  constituents'  point  of  view,  anybody? 

22  MR.  SELDEN:     Personally  I  think  that  Gerry  can 

23  comment  on  that.     I  think  that  sort  of  short  range, 

24  immediate,  whatever,  decision-oriented  research  is 

25  under-funded.    I  think  there  are  a  lot  of  practical, 
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1  immediate  problems  that  don't  get  addressed.    I  would  hate 

2  to  see  that  happen  at  the  expense  of  basic  research 

3  because  I  think  that  the  research  that  has  been  going  on 

4  is  fabulous,  and  I  don't  mean  to  say  it  should  be 

5  displaced. 

6  But  I  don't  think  that  there  is  enough  of  that 

7  short-ranged  research,  and,  I  guess,  if  I  had  to  set  the 

8  priority  amongst  how  the  $2  million  is  allocated,  if  there 

9  is  just  sort  of  general  information  providing  facilitation 

10  going  on  in  the  laboratory,  I  would  prefer  to  see  less  of 

11  that  and  more  set  aside  for  potential  short  range, 

12  problem- solving  research.    But  that  agenda,  I  think,  needs 

13  to  be  determined  by  need  and  by  a  completely  competitive 

14  process. 

15  I  think  to  just  say  that  every  lab  will  do  40 

16  percent  applied  research  would  be  disastrous.    I  think 

17  that  OERI  ought  to  say  that  some  amount  of  applied 

18  research  ought  to  be  going  on  in  the  laboratories. 

19  MR.  STALFORD:    Could  I  ask  you  to  speculate  about 

20  the  implications?    Is  something  you're  saying  with  others 

21  as  well  as,  perhaps,  to  think  about  the  implications  of 

22  administering  the  laboratory  that  would  be  "more  grass 

23  roots  driven"  in  terms  of  responding  to  needs  that  come 

24  up?    Do  you  have  any  thoughts  about  how  one  would  staff 

25  such  a  place,  or  put  people  in  containers  or  keep  it  loose 
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1  and  flexible  in  a  way  that  I  think  some  of  your  comments 

2  would  suggest,  is  it  feasible  to  do  that? 

3  MR.  SELDEN:    A  fascinating  example  would  be  SWRL 

4  where  this  was  a  federally  funded  lab  which  lost  its 

5  federal  funding,  whatever  that  was,  five  years  ago,  seven 

6  years  ago.    SWRL  vas  doing  a  service,  applied  research 

7  evaluation  program  development  for  ths  Los  Angeles  City 

8  schools,  a  little  bit  for  the  state  of  California,  a 

9  little  bit  for  the  state  of  Arizona  in  supplemental 

10  projects  apart  from  the  basic  lab  contract. 

11  If  I  were  trying  to  manage  something  that 

12  responded  to  my  constituents  or  my  region  or  forcing  me  to 

13  deal  with  the  region,  obviously  the  secret  of  success 

14  there  is  to  figure  out  what  they  want  in  staff,  hire 

15  people  so  that  you  uould  do  good  work  in  the  areas  that 

16  they  want  done.    Los  Angeles  happened  tc  want  a  lot  of 

17  structured,  individualized,  instructional  program 

18  development  and  that  is  what  SWRL  hired  a  staff  to  do. 

19  If  you  draw  a  line  and  say  I'm  going  to  serve 

20  California,  Utah,  Arizona,  and  a  couple  of  other  states,  I 

21  guess  I  would  spend  a  lot  of  time  identifying  the  work, 

22  the  very  specific  kind  of  work  that  those  states  need,  and 

23  it  could  be  incredibly  different. 

24  California  has  a  lot  of  work  going  on  in 

25  teachers,  and  teacher  assessment,  and  mentor  teachers,  and 
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1  that  sort  of  thing.    Utah  has  got  this  huge  demographic 

2  problem,  there  is  a  tremendous  growth  in  their  school  age 

3  population. 

4  So  what  I  did,  I  might  have  to  decide,  I  can 

5  serve  California  but  I  can't  also  serve  Utah  with  the  same 

6  institution  without  having  essentially  two  institutions 

7  under  one  roof,  and  I  might  have  to  make  a  practical 

8  decision  to  do  it  one  way  or  the  other. 

9  MR.  SROUFE:    My  assumption  about  the  labs  is  that 

10  they're  well-intentioned  people  working  as  hard  as  they 

11  can,  and  anything  we  say  that  is  critical  in  my  mind  is 

12  wrong,  not  to  the  people  who  are  making  more  effort,  but 

13  you  said  that  we'd  agreed  that  writing  policy  advice  for 

14  the  states  was  one  of  the  functions  that  we  would  buy,  and 

15  question  was  priorities.    I  would  not  buy  that  as  a 

16  function.    I  think  it  is  an  impossible  taste  for  the 

'7  regional  labs  to  try  to  provide  and  I  can't  imagine  the 

18  chiefs  looking  at  them  as  a  source  of  policy  advice,  I 

19  would  not  subscribe  to. 

20  In  terms  of  what  they  could  do  with  a  little 

21  extra  money,  one  of  the  things  that  has  been  noted 

22  already,  in  all  of  our  R&D  budgets  we're  working  out  of 

23  a  culture  of  pove:ty.    And  so  we've  got  names  on  things 

24  that  are  totally  unrelated  to  reality.    But  we  call  them 

25  research  centers,  when  $400,000  is  not  a  center.    But  the 
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Vocational  Education  Research  Center  is  a  center  that  is 
$6  million  and  we  don't  have  any  of  them.    But  we  call 
them  centers  and  then  we  call  these  things  laboratories 
and  I  suspect  25  years  ago  someone  had  a  concept  of  a 
laboratory,  like  the  laboratories,  they're  not 
laboratories.    What  we  found  ourselves  doing  is  trying  to 
keep  accommodating  a  shrinking  budget  and  expanding  needs, 
and  so  we  get  into  these  little  mind  games,  we  could  do 
this  or  we  could  do  that. 

It's  clear  that  there  is  a  function  that  needs  to 
be  done  here.    No  matter  how  good  the  research  is,  it 
don't  lend  itself  application  to  classrooms  from  wherever 
it  comes  from,  and  that  is  very  hard  work.    I  think  a  lot 
of  times  people  assume  that  AERA  feels  that  the  centers 
are  the  only  things  that  count.    Well  we  think  they  count 
but  that  is  certainly  not  the  end  of  the  education 
product . 

W.W.  Charters  wrote  an  article  about  20  years  ago 
about  idea  men  and  engineers  in  education,  or  maybe  it  was 
just  the  opposite,  engineers  and  idea  men,  and  his  point 
was  that  all  we  talk  about  in  education  are  the  ideas, 
cooperative  learning,  or  new  kinds  of  reading  programs, 
and  we  never  talk  about  what  it  takes  to  get  those 
effectively  into  a  school  system. 

The  engineering  aspect  of  it,  and  Charter's  point 
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1  was  that  we've  got  a  malfunction  in  our  system,  I  think 

2  that  is  true  and  I'd  like  to  see  what  we're  calling  the 

3  laboratory  piece,  not  only  there  but  in  a  much  more  highly 

4  funded  level.    But  it  seems  to  me  what  we're  doing  now  is 

5  not  that  at  all.    We're  making  this  system  work,  we're 

6  articulating  the  system  that  we've  been  given.    But  it 

7  isn't  doing  that. 

8  I  think  the  idea  of  having  people  try  to  do  much 

9  less  and  doing  it  better,  how  would  you  take  cooperative 

10  learning  and  get  it  into  the  schools.    That  alone  could  be 

11  a  function  of  laboraties  and  not  have  to  be  doing  all  of 

12  these  other  things  that  they're  required  to  do  now  to 

13  justify  a  piddling  amount  of  money.    Look  at  the  other 

14  federal  agencies,  the  R&D  things,  $7  billion  in 

15  military. 

16  So  I  think  we  have  to  keep  that  in  mind.    But  I'm 

17  a  little  uncomfortable  saying  we've  got  nine  of  these.  At 

18  one  time  we  had  26,  as  I  recall.    Maybe  we  should  have 

19  three,  and  I'd  like  to  keep  that  issue  open  but  talk  about 

20  what  is  the  function  here,  what's  needed  in  education. 

21  Clearly  what's  needed  is  applied  research  and 

22  packaging  and  addressing  peoples'  needs  as  they  come  up. 

23  I  don't  think  the  laboratory  system  allows  us  to  do  that 

24  very  well.    Just  by  the  way  it's  designed.    I  think  that 

25  must  be  a  total  frustration  for  people  trying  to  run  these 
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1  organizations  and  keep  them  viable,  satisfy  all  these 

2  demands . 

3  I  would  think  that  one  of  the  states  decided  that 

4  the  labs  could  not  help  them  with  their  problem.  Of 

5  course  not,  how  many  problems  can  a  lab  be  expected  to 

6  help  anyone  with,  and  I  think  the  proper  response  from  the 

7  lab  would  be,  that  is  fine,  but  what  we're  doing  is  this. 

8  But  they're  kind  of  denied  that  because  they're  supposed 

9  to  serve  all  comers,  and  I  think  that  is  not  a  reasonable 

10  thing  to  do. 

11  I  think  they  would  be  better  off  if,  instead  of  a 

12  regional  focus,  they  had  a  topic  focus  and  they  would  be 

13  engineers  of  educational  ideas. 

14  MS.  HENDERSON:    How  would  that  jive  with  the  idea 

15  for  the  centers? 

16  MR.  SROUFE:    What's  happened,  I  think,  is  that 

17  both  groups  are  moving  toward  the  middle  by  plan  because 

18  the  centers,  in  order  to  justify  their  budget,  because  the 

19  previous  director  thought  they  should  be  well-known  in  the 

20  area  and  then  they've  gone  into  dissemination  on  a  large 

21  scale  and  in  large  part,  that  is  how  they  feel  they're 

22  evaluated.    So  they're  doing  some  of  what  the  labs  might 

23  be  doing  and  the  question  of  articulation  we  haven't 

24  addressed  yet. 

25  MR.  STALFORD:    Let  us  welcome  Anne  Henderson  from 

ERIC  b-J 


1 


48 


1  the  National  Committee  for  Citizens  and  Education.  Thank 

2  you,  Anne.    There  seems  to  be  movement  to  get  coffee.  Why 

3  don't  we  take  a  minute  or  to  to  get  some  coffee. 

4  (Short  break.) 

5  MR.  SMITH:    I  just  wanted  to  pursue  a  point  that 

6  Gerry  Sroufe  raised  which  was  the  question  of  applied 

7  research,  and  we've  been  discussing  what  the  labs  do  as  a 

8  dissemination  or  as  a  service,  and  Jerry  raised  the  point 

9  that,  in  fact,  there  is  a  need  to  create  some  sort  of  step 

10  in  between  pure  research  in  the  classroom  and  that  it 

11  might  be  —  I'm  not  exactly  sure  what  that  is,  what  its 

12  characteristics  would  be,  how  it  differs  from 

13  dissemination  of  effective  practices,  let's  say.    Can  you 

14  address  that  for  a  minute,  Gerry,  and  clarify  the  sorts  of 

15  things  that  you  might  mean  need  to  be  done  in  some  format, 

16  in  some  structure  to  bring  applied  research  to  bear  on  the 

17  classroom? 

18  MR.  SROUFE:    You  have  a  center  in  Pittsburgh  and 

19  some  of  the  work  they're  doing  is  with  cognition  and  they 

20  seem  to  be  able  to  learn  things  about  how  people  learn 

21  that  are  applicable  to  Math  and  Reading  and  maybe  even 

22  writing  and  it  seems  to  be  a  very  rich  source  of 

23  understanding  that  we  can  use  in  the  schools. 

24  But  we  can't  use  it  in  the  schools  just  as  it 

25  comes  out  of  Bob  Glazer's  research.    What  we  have  there 


ERLC 


49 


1  are  some  interesting  things  and  he  tells  some  interesting 

2  stories.    He  was  in  town  last  week  and  told  about  some  of 

3  the  things  they  are  learning  about  how  people  go  about 

4  learning.    That  work  obviously  has  application  to  the 

5  classroom  and  to  the  work  teachers  do.    But  it  doesn't 

6  have  application  as  it  comes  from  Bob  Glazer.    It  needs 

7  someone  who  knows  about  the  teaching  process,  and 

8  different  grade  levels,  and  different  subject  matters  to 

9  say,  this  is  how  we  can  use  this  to  design  a  really  good 

10  math  program.    This  is  the  step  we  don't  have. 

11  it  turns  out  that  people  at  Pittburgh  are  very 

12  talented  and  that  they  do  a  lot  of  this  type  of  work.  But 

13  there  are  only  a  few  people  there  and  shaping  research  so 

14  that  it  makes  sense  in  the  classroom  is  another  thing 

15  althogether.     I  don't  think  we  are  doing  this  piece.  What 

16  we  are  riding  on  is  the  fact  that  people  like  Lauren 

17  Resnick  understand  classrooms  and  have  translation  ideas 

18  in  the  back  of  their  minds  as  they  are  doing  the 

19  reasearch . 

20  But  getting  it  into  a  format  and  into  the 

21  classroom  and  evaluating  it  is  another  aspect  of  the 

22  process.    I  think  we  do  very  well  with  the  resources  we 

23  have  in  coming  up  with  good  ideas  about  Math,  Reading, 

24  Science.    But  where  the  process  drops  off  is  in  terms  of 

25  putting  them  into  the  classroom.    That  we  be  an  example  of 
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1  where  I  think  we  ought  to  go. 

2  MR.  SMITH:    Can  anybody  suggest  a  model  or 

3  models  that  do  that  well  apart  from  the  Regional  Lab 

4  Network.    For  example,  is  there  some  sort  of  institution 

5  that  does  well  at  applying,  translating  basic  research 

6  into  the  classroom,  whether  it's  done  on  a  regional  basis 

7  or  a  local  basis,  or  generically  across  the  country  for 

8  diciplinary  or  topic  area?    You  don't  need  to  answer  that 

9  right  this  moment.     It  would  be  useful  if  we're  going  to 

10  think  about  applying  research  to  have  some  other  models  to 

11  look  at. 

12  MR.  SELDEN:     I  think  there  are  some  instances 

13  where  some  institution  does  that.    I  was  thinking  of 

14  reading  after  the  cognitive  research  that  Pittburgh  and 

15  Illinois  did,  and  reading  sort  of  revealed  these  processes 

16  of  comprehension  that  good  readers  have  that  poor  readers 

17  Jon't  have. 

18  The  New  York  city  school  system  ran  a  project 

19  called  STAR  which  put  together  teacher  techniques  and  a 

20  professional  development  program  to  show  teachers  why 

21  these  things  were  important  and  how  to  teach  them.    It  was 

22  a  very  hands-on  teacherly,  traditional,  professional 

23  development  approach.    Things  were  very  concrete,  people 

24  were  given  a  lot  of  stuff  that  they  could  take  back  and 

25  start  using  the  next  week,  it  was  very  applied. 
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1  MR.  FARSTRUP:    I  can  give  another  similar 

2  example,  the  Orange  County  Florida  schools  in  the  Orlando 

3  area  are  working  with  their  secondary  teachers  in  much  the 

4  same  way.    They  have  a  staff  at  the  district  office  level 

5  who  are  very  familiar  with  the  basic  and  more  applied 

6  research  that  is  going  on  and  are  drawing  from  a  number  of 

7  sources  and  have  a  very  extensive  staff  development 

8  program  where  they  work  directly  with  the  secondary 

9  teachers  and  the  middle  school  teachers  to  demonstrate  the 

10  techniques  that  are  research-based  to  help  them  move  those 

11  into  their  classroom  and  to  help  them  evaluate  the  impact. 

12  But  there  you  have  a  district  level  staff  of  people  who 

13  are  well  versed  in  what  is  happening  in  research  and  who 

14  can  serve  as  translaters. 

15  I  think  it's  that  translation  function  that  is 

16  extremely  important  and  that  means  in  order  to  translate, 

17  you've  got  to  have  something  to  translate;  that  means  the 

18  basic  research  really  has  to  continue  and  it  has  to  be 

19  well  funded,  and  you've  got  to  find  some  mechanism  to 

20  support  these  translaters  at  the  local  and  state  level. 

21  Perhaps  the  labs  could  function  in  seme  way  there. 

22  MR.  SELDEN:    Gerry,  earlier,  suggested  the  labs 

23  could  be  organized  around  topics.    We  were  talking  at  the 

24  break  about  what  institution  would  do  that  if  you  took 

25  Science  instruction.    You  could  imagine  a  lab,  a  single 
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1  national  lab,  whose  mission  was  to  help  school  districts 

2  or  schools  or  teachers  improve  science  instruction  based 

3  on  the  best  thinking  and  research  on  how  people  learn 

4  science  and  how  science  testing  drives  the  structure  and 

5  so  on. 

6  This  lab  would  take  Orange  County  Florida  that 

7  wanted  to  work  on  Science  instruction  and  show  them  how  to 

8  put  together  a  curriculum  implementation  and  teacher 

9  professional  program  that  would  result  in  better  sciences. 

10  MR.  FARSTRUP:    The  Orange  County  project  is 

11  exactly  the  case  in  point  because  they  are  not  trying  to 

12  develop  a  secondary  reading  specialist,  what  they  are 

13  doing  is  working  with  the  teachers  on  Science,  Biology, 

14  Math,  Social  Sciences,  trying  to  get  them  tuned  in  to  what 

15  we  know  about  how  people  comprehend  what  they  read  so  that 

16  they  can  do  a  better  job  in  their  discipline  while  helping 

17  with  the  reading  comprehension  helping  process. 

18  MS.  HENDERSON:    Do  the  labs  do  any  training? 

19  MS.  LI L B - BR I LHART :    Yes,  a  great  deal  of  it.  I'd 

20  say  that's  the  one  function  all  nine  of  them  are  involved 

21  in. 

22  MS.  HENDERSON:    How  do  they  do  that?    How  do  they 

23  deliver  that?    Do  they  go  to  individual  school  districts 

24  and  hold  regional  training  events,  do  they  plug  into  other 

25  things,  or  what? 
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1  MS.  LIEB-BRILHART :    All  of  that  is  involved. 

2  Mainly  training  of  trainers  very  often  who  may  be  from 

3  SEAs  and  from  district  levels.    For  example,  Research  for 

4  Better  Schools  in  the  Mid  Atlantic  region  has  developed 

5  networks,  let's  say,  of  superintendents  or  of  others  who 

6  might  receive  training  in  a  particular  area  and  get  it 

7  down  —  or  people  work  with  superintendents  and  get  it 

8  down  into  the  districts,  or  they  might  work  directly  with 

9  a  district. 

10  MS.  HENDERSON:  Teachers? 

xl  MS.  LIEB-BRILHART:     In  some  cases  if  it's  on  a 

12  contract  basis.    But  normally  they're  on  a  level  where 

13  somebody  would  be  training  the  teachers. 

14  MS.  HENDERSON:    Training  somebody  to  train  them? 

15  MS.  LIEB-BRILHART:    Right,  because  of  the 

16  indirect  strategy. 

17  MR.  STALFORD:    Rams?y,  when  you  were  asked  befor< 

18  where  would  you  put  the  money,  you  said  essentially 

19  short-range,  immediate  problems.    Do  you  perceive  or  do 

20  others  perceive  that  those  problems  would  not  necessarily 

21  be  driven  or  derived  from  research  or  for  which  there 

22  might  not  even  be  a  research  base  around? 

23  MR.  SELDEN:    Let  me  give  you  an  example.     I  thin 

24  class  size  is  a  good  example.    The  state  of  Tennessee 

25  spent  nearly  $5  million  doing  a  controlled  planned 
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1  variation  experiment  on  the  effects  of  small  classes  where 

2  they  had  some  kids  in  a  control  group  with  big  classes, 

3  and  some  kids  in  a  treatment  group  with  small  classes,  and 

4  they  ran  it  over  a  period  of  time,  and  they  had  it  going 

5  on  at  the  primary,  elementary  and  secondary  levels. 

6  Tf       \s  an  issue  that  the  research  community 

7  feels  that  the  real  issues  there  are  much  more  complicated 

8  and  that  the  interaction  between  students  and  teachers  is 

9  a  much  more  complex  phenomenon  than  that  kind  of  a  project 

10  would  help  them  s^lve. 

11  Meanwhile  states  of  California,  South  Carolina, 

12  and  Tennessee  were  under  a  lot  of  pressure  to  lower  class 

13  size.    And  people  kept  telling  them  we  don't  really  know 

14  whether  class  size  makes  a  difference.    Nothing  in  the 

15  liter*.  cuie  would  suggest  it  does  but  J'  is  essentially  an 

16  unresolved  problem. 

17  So  Tennessee  conducted  this  three  or  four  year 

18  controlled,  variation  study  to  find  out  and  inform  their 

19  own  policy  making.    Essentially  it  was  not  particularly, 

20  theoretically-grounded  research.    It  was  pretty  immediate. 

21  MS.  HENDERSON:    What  did  they  find? 

22  MR.  SELDEN:     I  think  it  works  for  the  lowest 

23  achievers  at  the  lower  grade  levels.    That  is  where  it 

24  paid  off.    I  guess  that  is  an  example.    Please  don't 

25  interpret  that  as  saying  that  the  laboratories  ought  to 
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1  have  40  percent  of  their  efforts  put  into  class  size. 

2  It's  a  class  of  issues  that  they  had  to  deal  with  that  is 

3  not  theoretical. 

4  MR.  STALFORD:     I  wonder  if  I  could  change  the 

5  direction  a  little  bit  here,  not  entirely,  in  part  to  give 

6  Ron  Field  a  chance  to  make  some  comments. 

7  Let  me  introduce  the  issue  this  way.    At  the 

8  recent  Laboratory  Review  Panel  meeting,  one  of  the  issues 

9  that  was  discussed  was  the  degree  to  which  laboratories 

10  should  devote  their  energies  towards  serving  chief  state 

11  school  officers  and  or  other  constituents.    And  the  issue 

12  is,  in  part  at  the  state  level,  to  what  degree  should  the 

13  laboratories  be  oriented  towards  the  needs  of  chiefs  as 

14  opposed  to  —  I  don't  mean  that  literally  —  but  versus 

15  the  needs  of  state  legislatures  rr  governors,  but  also  tc 

16  what  degree  —  this  is  a  broader  issue  —  should  they  be 

17  focused  upon  state  needs  and  to  what  degree  compared  to 

18  the  needs  of  other  groups  within  a  state  —  local, 

19  intermediate,  parent  groups,  groups,  perhaps,  that  would 

20  not  be  seen  as  so  high  in  a  kind  of  hierarchy  in  at  least 

21  authority. 

22  There  are  opinions  on  both  sides  of  that,  and  I 

23  believe  the  labs  currently  vary  quite  a  lot  in  their  own 

24  behavior  towards  that. 

25  Let  me  offer  you  the  opportunity  to  comment  on 
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1  that  or  anything  related  to  that. 

2  MR.  FIELD:    I'm  delighted  to  be  asked  here.  I'm 

3  probably  the  least  authoritative  person  on  the  labs  and 

4  centers;  although  I  should  say  that  I  did  serve  as  a 

5  research  assistant  when  I  was  in  graduate  school  at  the 

6  University  of  Oregon  at  the  Northwest  lab  and  it  was  only 

7  as  a  result  of  that  experience  that  I  know  that  even  20 

8  years  ago  that  at  least  that  particular  lab  did  try  to 

9  serve  a  state  policy  issue  that  was  brought  to  them  by  the 

10  Governor's  office  in  Montana,  I  want  to  say  Wyoming, 

11  although  I  don't  know  that  is  in  that  region  now  or  ever 

12  was. 

13  But  Idaho  and  Washington  State  had  to  do  with  a 

14  subject  that  still  seems  to  be  swirling  around  us,  drug 

15  education,  and  I  was  assigned  to  that  project.     I  think 

16  what  was  come  up  with  was  up  to  the  Governors'  offices,  as 

17  I  recall,  I  remember  a  meetina  sround  a  cable  much  like 

18  this,  at  which  they  could  choose  to  accept  the  information 

19  that  the  lab  put  before  them  or  not  and  a  lot  of  this  they 

20  rejected  out  of  hand  as  not  operable  for  their  states. 

21  But  at  least  there  was  an  indication  of  an  interest  at 

22  that  time  by  that  particular  lab  to  deal  with  a  real 

23  policy  issue  that  was  brought  to  them  by  the  governors  of 

24  three  or  four  states. 

25  I  was  reading  the  fact  sheet,  and  this  is  going 
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1  to  be  a  detoured  way  of  answering  you    question.    As  I  was 

2  reading  down  and  I  read  the  definition  of  what  the 

3  laboratories  were  set  up  to  do  and  what  the  premises  were 

4  for  their  continuation,  and  I  was  trying  to,  perhaps  in  a 

5  strained  way,  to  extrapolate  from  that  to  find  out  why  I 

6  was  here,  until  I  got  down  to  near  the  very  end  of  the 

7  page  and  here  was  this  parenthetical  thought  or  comment 

8  almost  as  an  afterthought  that  laboratories  were  also  to 

9  serve  state  decision  makers'  needs  directly  with  a  portion 

10  of  their  funds. 

11  It  seamed  a  rather  tentative  way  to  state  that. 

12  And  maybe  the  reason  for  that  is  what  Mr.  Sroufe  said, 

13  that  this  is  a  very  difficult  thing  to  do  for  the  labs.  I 

14  don't  know  if  it's  impossible.    But  it  seems  to  me  that  in 

15  dealing  with  public  policy  issues  as,  and  education  is 

16  certainly  the  largest  of  all  those,  and  when  you're 

17  talking  about  assisting  state  legislatures  and  doing  their 

18  jobs  relative  to  education,  it  is  a  very  large  job  indeed 

19  because  legislatures  finds  themselves  in  a,  especially 

20  today,  very  interesting  place. 

21  If  you  take  the  federal  system  that  our  country 

22  has,  that  is  the  states  and  the  national  government 

23  together,  and  you  recognize  that  the  federal  government 

24  has  no  constitutional  mandate  in  education,  and, 

25  therefore,  it  becomes  a  reserved  power  of  the  states,  and 
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1  most  state  constitutions  specifically  charge  the 

2  legislatures  with  a  responsibility  of  providing  for  a 

3  system  of  common  schools.    And  the  states  and  the 

4  legislatures,  very  sensitive  to  the  politization  of 

5  education  over  the  years  have  chosen  to  delegate  that  out 

6  all  sorts  of  ways. 

7  In  some  states,  of  course,  a  state  board  of 

8  education  may  be  a  constitutional  entity,  in  many  states 

9  it  is  not.    In  a  few  states  the  chief  state  school  officer 

10  is  an  elected  official,  in  most  states  he's  not.    In  only 

11  one  state  in  the  union  do  school  districts,  local  school 

12  districts  have  any  kind  of  constitutional  authority.  In 

13  49  of  the  50  states  they  are  statutory  creatures  of  the 

14  legislature.    Now  we  found  ourselves  where  since  1983, 

15  state  legislatures  appropriate  over  half  of  all  the  money 

16  in  the  country  to  support  public  schools. 

17  That  was  a  fairly  important  historical  landmark, 

18  it  seemed  to  me,  that  we  passed.    And  I  doubt  if  we'll 

19  ever  see  it  go  back  the  other  way.    If  anything  it  may 


20 


only  get  to  be  more.    I  was  going  to  say  get  worse  or 


21  better. 


22  But  it  has  also  had  the  affect  of  injecting  the 

23  legislature,  like  it  or  not,  back  into  the  decision  making 

24  process,  in  a  very  big  way  in  some  states,  as  to  what 

25  education  shall  be,  shall  look  like,  shall  operate  in  a 
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1  given  state. 

2  So,  we  come  to  a  point  where  with  this  newly 

3  refound  responsibility,  legislatures  need  information  more 

4  than  ever  to  deal  with  these  issues.    These  are  issues 

5  that  you  bring  together  in  a  group  of  a  couple  hundred 

6  people.    There  may  be  a  few  teachers  among  them;  although 

7  when  I  worked  at  the  Oregon  legislature,  when  I  left  there 

8  in  1975,  it  was  very  interesting  to  note  that  teachers 

9  were  the  largest  single  occupation  in  the  legislature, 

10  especially  in  the  house.    I  doubt  if  that  happens  in  too 

11  many  states. 

12  But  in  any  case,  they  find  themselves  now  with 

13  tremendous  need  for  information,  and  I  should  say  that  we 

14  are  now  at  a  point,  too,  where  not  only  do  states 

15  appropriate  about  52  percent  or  so  of  all  moneys  for 

16  education,  for  public  education,  and  some  for  private 

17  education,  and  that  not  only  that  it  has  become  the 

18  largest  single  item  in  every  state's  budget.    So  we're 

19  talking  about  a  major  public  policy  issus  at  the  state 

20  level. 

21  We've  been  trying  to  find  ways  to,  as  an 

22  organization  that  is  considered  by  the  IRS  an  extension  of 

23  state  governments,  we  and  the  Governors  Association  are 

24  both  viewed  that  way,  and  we've  been  trying  to  find  a  way 

25  as  a  service  organization  for  them,  as  well  as  a  federal 
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1  lobbying  organization  for  them,  to  find  ways  to  develop 

2  more  informational  opportunities. 

3  One  of  these  has  been  to  discuss  some  of  this  ^ 

4  possibility,  some  of  these  opportunities  with  a  couple  of 

5  the  labs.    There  are  a  couple  of  lab  directors  who  are 

6  particularly  interested  in  working  with  and  through  NCSL 

7  in  providing  issue  specific  assistance  information  to 

8  serve  legislative  policy  needs. 

9  There  used  to  be  a  project  tha^.  we  operated 

10  jointly  with  NIE  and  than  OERI  that  provided  a  small 

11  amount  of  incentive  money  for  state  legislative  studies  in 

12  education  policy.    That  provided  an  awful  lot  of  service 

13  for  a  small  amount  of  dollars.    It  often  times  provided  an 

14  opportunity  for  legislative  research  staff,  or  legislative 

15  fiscal  staff,  or  an  education  staff  in  one  or  another 

16  house  of  a  legislature  to  deal  with  an  issue  within 

17  education,  often  times  related  to  education  finance. 

18  But  as  in  the  case  of  Tennessee  in  recent  years 

19  when  the  Merit  Teacher  Program,  the  Teacher  Ladder  Program 

20  was  a  big  howling  issue,  it  was  resolved  interestingly 

21  enough  in  a  negotiaion  between  the  legislature  and  the 

22  Governor  based  on  findings  from  this  little  piece  of 

23  applied  research  that  was  funded  through  this  cost-sharing 

24  program  that  came  through  NCSL  from  OERI. 

25  Clearly  because  legislatures  are  policies  and 
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1  appropriating  bodies,  a  lot  of  what  they  deal  with  in 

2  terms  of  schools  is  school  finance.    That  seems  to  be 

3  where  a  lot  of  the  policy  shakes  out.    This  has  become  a 

4  big  issue  again.    That  is  how  the  cost-sharing  awards 

5  first  began  in  1976,  it  was  a  combination  of  a  Ford 

6  Foundation  grant  and  an  NIE  grant  because  during  the  old 

7  days  that  was  a  very,  very  big  issue. 

8  Now  it  seems  to  me  that  that  issue  is  coming  back 

9  with  a  vengeance.    Clearly  the  the  Supreme  Court  in  the 

10  the  state  of  Kentucky  certainly  thinks  it's  a  big  issue, 

11  and  I  understand  that  Tennessee,  looking  next  door  to  its 

12  neighbor,  already  some  public  officials  have  already  said 

13  there,  maybe  what  they  did  is  good  idea. 

14  In  any  case,  school  finance  and  the  equitability 

15  of  funding  school  districts  across  states  and  especially 

16  with  legislatures  more  into  the  issue  than  ever  before 

17  with  the  amount  of  money  they  put  into  it  is  going  to  be  a 

18  very  important  issue  in  the  next  few  years,  I  think,  with 

19  legislatures. 

20  I  was  considering  some  of  the  questions  that  were 

21  asked  here.    What  activities  conducted  have  been  the  most 

22  valuable  to  our  constituents?    I  don't  know  if  I  could 

23  name  any.    I  don't  know.    Clearly  it  seems  that  the  labs 

24  were  not  set  up  to  serve  state  legislatures  and  so  there 

25  is  no  reason  to  expect  that  &:icept  by  accident,  perl*aps, 
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1  or  by  some  very  indirect  means  through  the  dissemination 

2  process  that  anything  that  they  would  have  done  would 

3  necessarily  have  been  aimed  at  serving  state  legislatures. 

4  So  that  is  not  a  criticism,  that  is  just  an  observation. 

5  What  ar«*  the  key  educational  issues  in  the 

6  future?    I  don't  know  that  anything  we've  ever  delt  with 

7  has  really  gone  away.    I  have  been  in  the  business  of 

8  education  and  education  policy  since  the  mid  60s,  and  I'm 

9  always  amazed  that  things  keep  repeating  themselves,  or 

10  how  they  keep  repeating  themselves.    Maybe  at  a  somewhat 

11  different  plane. 

12  But  basically  the  same  fundamental  issues  keep 

13  coming  back,  and  that  is  not  bad,  necessarily.  Although 

14  it  does  say  we  never  really  resolved  some  of  those 

15  problems  to  begin  with.    But,  you  know,  it's  an 

16  evolutionary  process,  and  we're  still  working  at  it  and 

17  that  is  important  and  we  probably  solve  a  little  bit  of  it 

18  each  time  it  comes  around. 

19  So  the  issues  are  all  there.    We're  still  talking 

20  about  education  finance,  how  to  serve  rural  areas  along 

21  with  urban  areas,  and  that  has  even  become  more  difficult 

22  at  the  state  level.    Somebody  asked  me  the  other  day  in  a 

23  different  forum,  well,  it's  always  been  kind  of  the  common 

24  perception  that  state  legislatures  were  kind  of  weighted 

25  toward  the  rural  side  because  that  is  where  most  of  the 
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1  legislatures  came  from. 

2  That  was  probably  true  before  one  man-one  vote. 

3  But  increasingly  as  our  society  has  concentrated  more  into 

4  not  only  urban  areas,  but  contiguous  urban  areas  within 

5  states  and  between  states  increasingly  the  proportion  of 

6  legislators  that  serve  in  the  state  legislatures  are 

7  elected  from  more  urban  and  suburban  settings.    And  so 

8  rural  areas  no  longer  have  that  kind  of  control. 

9  So  there  are  some  specific  issues  there  now  that 
they  are  starting  to  raise  their  heads  about  how  do  you 

11  serve  the  economic,  social  educational  needs  of  rural 

12  areas. 

13  But  then  at  the  same  time  you've  got  the  impacted 

14  inner  cities  in  a  lot  of  states  with  some  tremendously 

15  serious  problems  there,  and  that  problem  seems  to  be  one 

16  that  gets  worse  instead  of  better,  and  how  do  you  resolve 

17  that,  and  all  of  the  other  things  in  between,  the  problems 

18  of  Math  and  Science  education  and  our  comparative  results 

19  to  other  nations  in  the  world,  how  we're  going  to  compete 

20  in  a  global  society. 

21  So  not  only  do  the  same  problems  keep  coming 

22  back,  but  I  think  they  get  compounded  now  with  some  of  the 

23  other  things  that  are  added  on  top  of  them.    Before  it  was 

24  only  a  matter  of  how  could  you  provide  enough  people 

25  within  your  community  to  serve  the  manufacturing  needs ,  or 
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1  whatever  it  was,  of  that  community  and  in  the  state 

2  economic  development  became  a  big  issue.    And  now  not  only 

3  do  we  have  national,  but  global  concerns.    And  it  really 

4  is  global.    Hov  many  communities  are,  perhaps,  not  at  the 

5  elementary,  secondary  level;  although  there  is  some 

6  concern  about  that  especially  at  the  secondary  level  with 

7  vocational  education  and  how  it  ties  into  training  to 

8  attract  manufacturers  from  abroad. 

9  It  really  is  a  compounded  problem  and  it  all 

10  revolves,  perhaps  as  it  always  has,  around  economics  and 

11  how  to  serve  the  economic  needs  of  a  community  or  a  state, 

12  whatever. 

13  The  kinds  of  strategies  and  activities  that  would 

14  most  benefit  our  constituency,  I  guess,  really  need  to  go 

15  down  to  the  last  question  in  the  form  of  relationship  to 

16  begin  to  answer  that.     I'm  not  altogether  sure.     I  jotted 

17  down  three  possible  ways  that  a  regional  laboratory  might 

18  assist  a  state  legislature  or  state  legislatures.  My 

19  first  thought  was,  taken  in  the  most  direct  way,  would  a 

20  laboratory  be  able  to  serve  on  a  one-to-one  basis,  a 

21  state,  or  on  a  state-by-state  technical  assistance  basis 

22  dealing  with  applied  i  ^.search  in  a  particular  policy  area. 

23  First  of  all,  I  don't  know  that  a  state 

24  legislature  would  know  to  call  upon  them.    So  that  would 

25  mean  developing  a  relationship  by  way  of  communication 
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1  with  leadership  of  the  chambers  in,  perhaps,  their  own 

2  region  or  maybe  going  to  the  concept  of  the  laboratories 

3  developing  expertise  in  particular  areas  that  people  would 

4  know  to  go  to  them  to  deal  with  a  particular  educational 
"5  issue. 

t  But  I'm  not  so  sure  that  that  really  is  going  to 

7  work  because,  again,  I  do  not  envision  as  currently 

8  structured,  the  laboratories  being  the  kind  of  place  that 

9  many  state  legislators  are  going  to  be  comfortable  going 

10  to.    They  don't  see  them  as  part  of  that  informational 

11  system  that  they  might  even  feel  comfortable  with.    It's  a 

12  professional's  laboratc     .    It  belongs  to  the  education 

13  community.    It's  not  a  public  policy  laboratory. 

14  Then  maybe  we  could  deal  —  the  other  possibility 

15  is  to  ameliorate  some  of  those  concerns,  possibly  to  have 

16  what  may  be  developing  right  now,  in  fact,  a  relationship 

17  between  one  or  more  of  the  laboratories  through  an 

18  organization  like  NCSL  that  does  provide  direct  technical 

19  assistance  to  state  legislatures  in  a  number  of  policy 

20  areas,  education  being  only  one  of  many,  and  we  do  have  a 

21  whole  office  in  Denver,  our  State  Services  Office,  that 

22  does  nothing  but  this  kind  of  work.    It  does  applied 

23  research  and  technical  assistance  and  writes  briefing 

24  papers  that  provide  policy  option  recommendations  and  all 

25  those  kinds  of  things,  and  it  seems  to  me  that  through  the 
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1  information  and  dissemination  and,  perhaps,  issue-specific 

2  areas  that  the  labs  deal  with  that  we  might  be  able  to 

3  serve  as  a  disseminating  agent,  perhaps  as  a  brokering 

4  agent,  perhaps,  I  don't  know,  there  are  a  variety  of  ways 

5  that  seems  to  me  eight  be  possible  as  a  tandem 

6  arrangement . 

7  And  we  are  constantly  being  asked  by  state 

8  legislatures,  legislative  staff,  which  I  might  say  in  the 

9  last  20  years  especially,  20,  25  years,  not  only  at  state 
agencies  has  there  been  a  growth,  not  only  in  number  of 
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11  bodies  but  in  competency  and  capability,  that  has  been 

12  true  also  in  the  staffing  of  the  state  legislatures. 

13  Since  the  mid  to  late  60s  that  has  been  a  considerable 

14  growth  and  one  of  the  most  significant  parts  of  that  has 

15  been  the  development,  since  about  1970,  of  legislative 

16  research  staffs  at  the  state  level. 

17  Unfortunately  in  most  states  they're  not  very 

18  large  and  while,  especially  in  very  part-time 

19  legislatures,  they  may  be  one  of  the  very  few  pieces  of 

20  the  permanent  staff.    Often  times  when,  say,  a  small  state 

21  legislature  is  out  of  session,  the  only  staff  that  might 

22  remain  around  are  those  that  serve  the  leadership  offices, 

23  the  legislative  fiscal  staff,  and  maybe  a  couple  of  people 

24  in  the  legislative  research  office  that  actually,  not  only 

25  do  research,  but  wind  up  staffing  some  of  the  interim 
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1  committees  that  are  appointed  to  oversee  state  programs. 

2  That  being  the  case,  they  are  not  going  to  get  a 

3  lot  of  even  very  basic  applied  research  done  because  their 

4  staffs  are  pretty  small.    One  of  the  things  that  has 

5  occurred  to  us,  and  I've  been  thinking  about  it  only  in 

6  education,  I'm  sure  it,  too,  could  apply  to  other  areas. 

7  The  need,  especially  now,  is  to  provide  for  the  state 

8  legislatures  service  not  too  unlike  the  Congressional 

9  Research  Service  for  the  Congress,  an  on-call,  on-demand 

10  capability  that  they  can  call  upon  to  help  them  deal  in  an 

11  applied  research  manner  with  an  issue  specifically  aimed 

12  at  resolving  an  educational  policy  problem  within  their 

13  state  by  drawing  in,  perhaps,  results  of  this  kind  of 

14  study  that  might  have  been  done  in  other  states,  what  the 

15  legislature  did  about  it,  if  anything,  how  successful  or 

16  unsuccessful  it  may  have  been,  also  national  studies, 

17  studies  that  have  been  done  by  other  organizations, 

18  studies  that  might  have  been  done  by  CRS,  by  universities, 

19  a  national  applied  research  capability  that  would 

20  compliment  what  the  states  have  developed  for  themselves. 

21  But  take  it  a  step  beyond  that  and  really  make  it 

22  available  to  them,  a  data  base  that  would  equalize  then 

23  the  capability  of  all  the  states  to  —  or  would  make  equal 

24  their  capability  to  draw  upon  all  of  that  and  to  make 

25  decisions  for  their  states  with  the  best  information 
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1  possible.    That  is  a  big  task  and  how  the  labs  might  feed 

2  into  that  may  be  a  very  open  question.    But  it  is 

3  something  we're  working  on  and  we're  working  on  it  in 

4  conjunction  with  OERI  at  different  levels  and  with  other 

5  sources  as  well. 

6  We  have  to  start  at  that.    We  have  a  computerized 

7  data  base  called  LEGISNET,  it  deals  with  issues,  all 

8  issues.    But  there  is  a  base  of  information  in  there  that 

9  relates  to  education  already  that  could  be  built  upon  and 

10  supplemented  with  a  lot  of  other  things  and  I  would  like 

11  co  think  that  what  the  laboratories  do  could  contribute  to 

12  that  in  some  way. 

13  MR.  SMITH:     I'd  like  to  ask  a  question.  For 

14  policy  kinds  of  information,  do  you  know  whether 

15  legislatures  or  whether  NCSL  itself  wciks  with  CPRE, 

16  Center  for  Policy  Research  and  Education,  one  of  our 

17  funded  research  centers? 

18  MR.  FIELD:    Yes,  we  do  and  our  Denver  office 

19  does.    To  what  extent  I  couldn't  really  tell  you.     I  don't 

20  think  it  is  a  daily  basis. 

21  MR.  SMITH:     I  as  3d  that  because  I'm  kind  of 

22  puzzled  by  what  would  be  the  appropriate  relationship  for 

23  policy  information  between  a  lab  and  a  state  legislature 

24  or  between  the  labs  collectively  and  the  outfit  that 

25  you're  talking  about,  whether  some  version  of  CPRE,  which 
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1  was  more  research-oriented  rather  than  applied 

2  research-oriented  would  be  the  right  place  to  tap  for  that 

3  sort  of  information  or  whether  a  separate  kind  of  entity 

4  or  group  of  entities  might  be  more  appropriate? 

*  MR.  FIELD:    I  don't  know  that  I  really  can  answer 

6  that  question  right  now.    It  seems  to  be  something  that 

7  needs  to  be  thought  out  a  little  bit  more 

8  MR.  STALFORD:    Let  me  just  mention  something  for 

9  the  record.    As  the  author  of  that  particular  fact  sheet 

10  that  you're  referring  to,  the  kind  of  parenthetical 

11  reference  to  the  state  policy  work  was,  perhaps,  the 

12  appearance  was  —  the  conclusion  here  was,  perhaps,  not 

13  entirely  warranted,  that  is,  it  showed  up  that  way  because 

14  we  wanted  to  emphasize  the  pending  issue  about  the 

15  indirect  service  strategy  and  whether  that  should  remair 

16  the  same  or  not. 

17  In  fact,  it  was  an  afterthought  in  my  drafting  to 

18  be  clear  to  the  reader  that  the  indirect  service  strategy 

19  did  not  encompass  all  of  the  labs'  funding. 

20  However,  as  a  factual  matter,  task  three  of  the 

21  five  tasks  which  is  the  last  to  serve  in  state  decision 

22  makers  is  one  of  five.    It  is  not  the  largest.  The 

23  largest  task  is  to  work  towards  school  improvement  with 

24  and  V  .  ough  a  vanety  of  intermediaries,  basically,  or  in 

25  soms  cases  collectively.    That  is  task  two.    The  first 
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1  task  is  to  run  the  institution.    The  third  task  then  is  to 

2  work  with  state  decision  makers.    What,  Barbara,  I  don't 

3  recall  is  a  percentage  of  funding  that  goes  into  task 

4  three? 

5  MS.  LIEB-BRILHART:     It  varies.    There  is  a  wide 

6  variation.    All  of  the  labs  in  varying  degrees  have  done 

7  some  work  with  state  policy  and  decision  makers,  even 

8  state  legislatures.    The  Appalachia  Lab  has  produced  a 

9  number  of  policy  briels  on  issues  that  were  pending  in  the 

10  legislature,  and  I  think  most  of  them  have  done  something 

11  in  various  degrees. 

12  One  of  the  problems  I'd  like  your  feeling  on  is 

13  that  some  of  the  labs  find  themselves  getting  into 

14  political  battles  that  they'd  rather  stay  out  of  at  the 

15  state  legislative  level,  and  I  don't  know  how  you  avoid 

16  that  once  you  get  into  this  business. 

17  MR.  FIELD:    I  don't  exactly  know  what  you're 

18  referring  to  although  I  can  imagine,  depending  on  the 

19  state;  maybe  because  I  spent  the  weekend  there, 

20  Pennsylvania  corned  to  mind  which  is  a  highly  politicized 

21  state.    The  legislatures,  every  committee  of  the 

22  legislature  has  both  a  majority  and  minority  staff  and,  in 

23  fact,  the  two  parties  can  hold,  in  the  same  committee,  can 

24  hold  separate  hearings. 

25  So  it's  very  understandable  if,  let's  say,  the 

ERIC  (^o 


71 


1  republican  or  democratic  staff  of  the  house  education 

2  committee  called  for  some  information  that  wasn't  made 

3  available  to  the  other  side  that  could  be  pretty  sticky. 

4  But  there  are  states  where  that  can  happen  and  that  is  why 

5  I  suggested  that  on  a  state-by-state  direct  basis  it  might 

6  be  a  questionable  way  to  go.    I'm  sure  in  some  states  that 

7  would  work  fine  and  maybe  in  states  where  the  lab  resides 

8  and  they  know  who  they  are. 

9  But  I'm  thinking  more  that  working  with  and 

10  through,  perhaps,  NCSL  or  ECS,  some  kind  of  a  partnership 

11  whereby  some  very  good  technical  assistance  information 

12  and  material  could  be  developed,  say,  aiming  at  the 

13  resolution  of  a  particular  policy  issue  in  a  particular 

14  educational  area.    That  is  how  things  are  going  to  be 

15  d  When  we  provide  that  kind  of  technical  assistance, 

16  it  usually  comes  down  to  developing  what  we  call  a 

17  If:-  islature's  guide  to  a  particular  issue  problem,  public 

18  policy  problem  that  the  culmination  of  which  is  a  set  of 

19  policy  options  as  recommendations.    Never  presume  to  tell 

20  a  legislature  what  to  do. 

21  MS.  LIEB-BRILHART:    Never  an  advocacy  position. 

22  MR.  FIELD:    That's  right,  exactly,  it  is  not  an 

23  advocacy  position.    You  present  the  information,  detail 

24  the  scope  of  the  problem,  try  to  provide  some  background 

25  and  what  other  states  may  have  done  with  this,  what  some 
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1  of  the  current  state  of  the  art  thinking  may  be  on  it  from 

7  different  expert  sources,  and  if  possible,  then  develop 

3  around  that  some  policy  recommendations  that  they  might 

4  consider  for  themselves,  and  they  may  just  take  an  amalgam 

5  of  those  and  put  something  even  different  together. 

6  MR.  SMITH:    Excuse  me,  I'm  afraid  I  have  to  run 

7  to  a  meeting  upstairs.    But  I  want  to  thank  you  all  for 

8  coming,  and  please  continue. 

9  MR.  STALFORD:    Just  a  note  of  time,  we  are 

10  scheduled  to  break  at  11:45  or  before  then.    But  we  won't 

11  go  beyond.    Any  other  points,  Ron,  anything  else  you  want 

12  to  raise? 

13  MR.  FIELD:  No. 

14  MR.  STALFORD:    I  do  want  to  give  an  opportunity 

15  for,  Mary  Grace,  if  you  have  any  other  comments  on  behalf 

16  of  the  Council  or  Dr.  Heslip,  questions  that  you'd  like  to 

17  make.     I  was  going  to  ask  Anne  Henderson  when  she  comes 

18  back  the  same  thing.    Also  Laurence  Peters  and  Bob  Tate  if 

19  you  have  any  questions  or  thoughts  you  would  like  to 

20  introduce  here  and  other  federal  staff?    Mary  Grace. 

21  MS.  LUCIER:    We  don't  deal  with  them,  the  labs  at 

22  all.    From  time  to  time  we  have  had  meetings  out  of  town 

23  where  lab  people  would  come  and  explain  to  our  Council 

24  what  they  were  doing;  and,  frankly,  they  were  not  ;oo 

25  exciting.    And  I  won't  tell  you  where  it  was,  but  they 
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1  just  came  and  explained  how  principals  had  to  exercise 

2  leadership.    You  weren't  being  told  anything  new  or 

3  dramatic  of  how  this  would  technically  help  someone  who  is 

4  running  a  school.    So  I  really  can't  criticize  their 

5  performance  from  personal  knowledge. 

6  But  I  wondered  shouldn't  we  think  about 

7  inventorying  what  these  labs  which  have  presently  been 

8  funded,  what  have  they  accomplished,  what  actually  have  we 

9  found  out  that  does  work  for  them,  and  could  these  labs 

10  not  coordinate  *  little  better  with  the  centers.  The 

11  centers  might  have  some  guidence  on  how  should  the 

12  research  they've  been  finding  out  be  better  retailed  for 

13  the  consumer. 

14  It  strikes  me  that  there  might  be  some  leads 

15  there.    But  every  time  the  cycle  starts  up,  we  have  to 

16  start  from  sort  of  a  zero  based  knowledge  and  there  might 

17  be  some  breakthroughs  there. 

18  And  also  we  all  read  Education  Week.    We  are 

19  finding  that  there  are  so  many  of  the  theso  innovative 

20  ideas  that  are  coming  from  the  states  and  it  seems  to  have 

21  not  a  lot  to  do  with  the  labs  or  centers  or  any  of  these 

22  institutional  entities  that  the  labs  might  be  able  to 

23  broker  those  a  little  bit  more  effectively. 

24  Usually  my  members  are  strictly  west  coast  or 

25  east  coast  type  people.    Now  I'm  getting  more  of  a  middle 
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1  America  people  who  really  are  seeing  educational  products 

2  as  the  key  to  economic  progress  in  their  states.    So  that 

3  is  a  big  issue  with  us. 

4  Another  one  is  the  human  resource  crisis  in  the 

5  labor  force,  Project  2000  and  all  of  that  stuff.    That  is 

6  a  big  concern  to  our  members.    And  if  the  labs  have  any 

7  ideas  to  offer  us.    There  is  new  work  to  be  done  there. 

8  MR.  STALFORD:    The  topic  of  coordination  between 

9  labs  and  centers  and  indeed  labs  and  ERIC  and  the  National 
Diffusion  Network  has  been  before  us  quite  a  lot  recently. 

11  The  laboratory  Review  Panel  pointed  to  that  as  an  issue. 

12  Barbara  Lieb-Brilhart  was  recently  involved  in  a  meeting. 

13  Do  you  want  to  say  something  about  that,  Barbara? 

14  MS.  LIEB-BRILHART:    There  were  representatives 

15  from  labs,  centers,  NDN,  ERIC,  and  the  meeting  had  tried 

16  to  look  at  the  issue  of  collaboration  and  coordination. 

17  We  tried  to  chart  a  degree  to  which  it  was  going  on  and 

18  there  are  some  projects  going  on  between  labs  and  centers. 

19  It's  sporadic,  it's  not  on  a  systematic  basil,.  For 

20  example,  RBS  has  lots  of  projects  with  the  Johns  Hopkins 

21  Center  and  there  are  other  examples.    Geography  may  make  a 

22  difference  or  natural  interests.    But  it's  not  what  you 

23  could  call  a  system  at  this  point. 

24  I  think  what  we  also  found  were  that  there  were  a 

25  great  many  overlapping  functions,  more  than  we  had 
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1  suspected,  that  there  was  synthesis  going  on  in  all  four 

2  urograms,  there  was  some  applied  research  going  on  in  all 

3  four  programs,  and  some  dissemination. 

4  So  we  don't  have  a  clear  picture  of  those 

5  programs  working  together  as  an  articulated  system, 

6  although,  there  was  more  collaboration  going  on  than  we 

7  had  realized. 

8  MS.  LUCIER:    Just  getting  down  to  the  consumer 

9  level  because  our  members  who  obviously  are  not  here, 

10  there  are  only  15  of  them.     But  they  are  always  amazed 

11  when  we  find  that  the  stuff  has  been  done  and  it's 

12  available  in  labs. 

13  MR.  STALFORD:    We  have  in  the  evaluation  area,  we 

14  have  sought  to  do  more  evaluation  than  we've  been  able  do. 

15  we  haven't  nad  discretionary  funds  available  for  that  sort 

16  of  work.    The  laboratories  do  self  assessments.  They're 

17  illustrative  to  a  considerable  degree.    They  tend  to  focus 

18  on  information  to  improve  the  programs,  which  are 

19  understandable,  rather  than  a  study  of  the  impact,  per  se. 

20  If  we  had  money  we  would  have  attempted  to  compliment  that 

21  work.     But  we  haven't  had  a  great  deal  of  funds. 

22  We  will  have  a  study,  in  fact,  that  has  been 

23  completed  and  a  report  is  now  been  prepared  through  the 

24  National  Center  for  Educational  Statistics,  a  Fast 

25  Response  Survey  System  which  does  not  measure  the  impact 
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1  of  the  laboratories'  work  but  does  give  us  some  idea  of 

2  how  widely  it  is  spread  and  how  frequently  it  is  used. 

3  Not  only  the  laboratories  but  the  centers  and  ERIC  and  NDN 

4  as  well.    But  that  is  an  area  where  we,  indeed,  would  like 

5  to  have  more  information. 

6  MR.  SROUFE:    One  of  the  topics  that  came  up  in  a 

7  similar  meeting  designed  to  come  up  with  the  research 

8  agenda  for  the  centers,  which  I  was  intrigued  with,  was 

9  the  idea  of  focusing  on  how  information  does  in  fact  get 

10  transmitted  to  the  schools.    I  like  the  idea  for  two 

11  reasons. 

12  One  is  that  I  don't  think  we  know  how  the  process 

13  works.    We  have  our  assumptions.    For  example,  we  assume 

14  that  ERIC  is  the  right  way.     I  think  the  assumptions 

15  supporting  ERIC  are  totally  erroneous.    There  is  little 

16  pent-up  demand  for  research  knowledge  on  the  part  of 

17  classroom  teachers  in  the  form  provided  in  ERIC.  So, 

18  simply  making  the  information  more  convenient  to  find  is 

19  not  likely  to  increase  its  use.    We  make  similar,  untested 

20  assumptions  about  how  the  centers  and  labs  work  is 

21  accomodated  by  the  schools. 

22  And  the  other  part  of  the  idea  I  like  is  its 

23  comparative  approach  to  ways  in  which  ideas  get 

24  disseminated  in  the  rest  of  society.    What  it  costs  to  get 

25  an  idea  in  the  public's  mind.     I  was  interested  in  Mary's 


ERLC 


77 


1  comment  about  people  on  the  Council  not  being  aware  of 

2  some  of  the  things  going  on  in  education.    This  is  not 

3  really  suprising. 

4  Look  at  Batman,  a  simple  minded  idea,  and  how 

5  much  it  costs  to  get  people  to  recognise  it.    Yet  we're 

6  dealing  with  subtleties  of  great  magnitude,  and  a  system 

7  in  which  we  don't  fully  understand  how  ideas  get 

8  transmitted  and  used.    I  think  the  idea  of  NCES  doing  this 

9  evaluation  is  rediculous.    I'll  be  suprised  if  they  find 

10  any  evidence  of  the  impact  of  the  labs  or  ERIC  in  this 

11  hugh  education  system,  and  I  don't  know  why  we  should 

12  expect  that  they  would. 

13  But  I  think  the  idea  of  looking,  again,  at  how 

'  14  the  system  actually  works  is  better  than  looking  at  how  to 

15  make  the  various  pieces  we  have  work  better.    Maybe  we 

16  should  be  asking  about  how  to  improve  ERIC  by  looking 

17  again  at  how  the  system  actually  gains  and  uses 

18  information. 

ig  MR.  STALFORD:    Any  other  comments?  Laurence, 

20  Bob? 

21  MR.  PETERS:    Just  this  one  formal  one  which  is  to 

22  welcome  the  opportunity  to  participate  and  commend  you  for 

23  holding  this  meeting.    It  has  been  very,  very  useful  as 

24  you  begin  to  look  to  the  recompetitions. 

25  MR.  STALFORD:    Harris,  you're  here  from  the 
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1  Office  of  Elementary  and  Secondary  Education.    Do  you  have 

2  a  thought  or  two  about  how  this  relates  to  the  priorities 

3  in  that  office. 

4  MR.  KELLER:    Just  a  few  comments  because  two  of 

5  our  highest  priority  programs  right  now  have  been  touched 

6  upon,  and  that  is  our  math -science  and  our  drug  education. 

7  Our  Chapter  One  is  the  old-time  one  at  ECIA.    That  seems 

8  to  work  pretty  well  in  gathering  and  disseminating 

9  information. 

10  The  one  program  we're  concerned  about  right  now 

11  is  Math  and  Science.    We're  able  to  get  the  mon«y  out  to 

12  the  field.    But  then  what  happens  with  it  when  it  gets  out 

13  in  the  field,  we  don't  know.    And  we're  meeting  with  so 

14  many  different  organizations  and  I  know  that  FIRST  over 

15  here  is  involved.     (Note:  FIRST  refers  to  the  Fund  for  the 

16  Improvement  of  School"  and  Teaching  at  OERI.) 

17  But  how  through  the  labs  and  the  centers  and  the 

18  organizations  can  we  all  draw  this  together  so  xhat  we  can 

19  get  the  maximum  benefit  of  these  dollars  out  there 

20  because,  as  you  say,  we've  got  so  many  problems  in 

21  education. 

22  The  Math  and  Science  program  is  one  of  the  most 

23  critical.    1*1  we  aro  to  compete  with  all  the  various 

24  countries,  the  Japanese,  the  Germans  —  Germans  with  their 

25  centralized  education  systems  and  their  ability  to 
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1  target  —  get  on  these  things;  some  things  have  been 

2  started,  such  as  the  computer  consortium  down  in  Texas  and 

3  all. 

4  Anything  that  can  be  done  that  way  to  get  that 

5  information  out  to  everybody  concerned  would  be  of  great 

6  value  not  only  to  us,  but  to  all  the  Departments  of 

7  Education. 

8  MR.  STALFORD:    Okay  thank  you.    Any  other 

9  comments?    Anyone  from  OERI  staff? 

10  This  has  been  very  helpful  information  for  us.  I 

11  think  it  has  been  very  pertinent  to  a  number  of  central 

12  concerns  that  we  have  about  issues  for  the  future  of  the 

13  program. 

14  I  think  we're  about  finished.    Does  anybody  here 

15  at  the  table  have  any  other  further  or  final  thoughts 

16  they'd  like  to  make  about  these  issues? 

17  MS.  LUCIER:     I'm  always  interested  in  the 

18  commercial  culture  as  being  a  primary  educator  of  our 

19  children  and  they  do  a  marvelous  job.    I'm  wondering  if 

20  there  isn't  some  aspect  or  some  criteria  on  how  the 

21  commercial  aspect  in  the  commercial  culture  really  impacts 

22  on  the  kids? 

23  MS.  LIEB-BRILHART:     That  is  a  very  good  point  and 
?4  it  relates  to  some  other  points  that  were  made.    I  think 
25  the  answer  is  money.     I  think  you  can  do  much  more  with  a 
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1  commercial  budget  than  with  $2  million  for  a  lab  per  year 

2  or  less  and  I  think  we're  talking  about  marketing  and 

3  redundancy  over  and  over  between  the  same  message  which 

4  takes  a  lot  of  resources. 

5  MS.  LUCIER:    We've  got  unbelievably  old  models 

6  and.    They  are  doing  an  astonishing  job,  and  I'm  wondering 

7  if  there  is  not  a  whole  lot  of  unused  knowledge  out  there 

8  that  we  can  — 

9  MS.  LIEB-BRILHART:    Sure  there  is  a  lot  we  can 

10  learn  from. 

11  MS.  LUCIER:    Everybody  is  potentially  a  customer. 

12  MR.  FARSTRUP:    Given  the  smallness  of  the 

13  resources,  it  seems  to  me  that  fine  tuning  may  not  be  an 

14  answer.    I  think  you  need  to  look  at  fundamental  design 

15  issues.    And  I  like  what  Ramsay  said  early  on,  you  may 

16  need  to  look  at  more  radical  changes  in  the  way  of 

17  structure  than  simply  trying  to  make  a  20  or  25  year  old 

18  creature  limp  along  for  a  few  more  years. 

19  I  think  there  are  a  lot  of  fine  researchers  out 

20  there  that  are  not  being  used  to  their  full  potential  and 

21  tt*ey  are  able  to.    I  think  funding  is  at  the  core  of  a  lot 

22  of  this.    You're  asking  more  and  giving  less  all  the  way 

23  along,  and  you're  over  promising  and  under  delivering. 

24  I'd  rather  see  more  focused  efforts  and  over-delivery. 

25  MR.  SELDEN:     I  guess  I  would  close.    And  a  real 
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1  caution  on  this  whole  principle  over  the  last  period  of 

2  time  on  indirect  activities  because  I  can't  imagine 

3  anything  worse  than  education  to  try  to  improve  through 

4  indirect  actions. 

5  I  think  what  Ron  was  saying  earlier,  how  you  work 

6  through  those  intermediary  organizations  must  become 

7  extremely  thoughtful,  strategic  and  promising  in  terms  of 

8  the  likely  payoff  because  there  is  a  lot  you  can  do 

9  indirectly  that  can  accomplish  zip,  you  know,  just  by 

10  loss. 

11  MR    FIELD:     I  would  like  to  just  add  to  that 

12  because  I  think  it's  absolutely  right,  that  isn't  so  much 

13  that  for  instance  an  organization  like  NCSL  is  an 

14  intermediary,  but  we're  a  trusted  part.    The  reason  that 

15  that  works,  at  leart  in  our  case,  is  that  we're  seen  as  a 

16  trusted  section  of  the  state  legislatures  themselves. 

17  So  it  is  more  likely  that  they  would  come  to  us 

18  and  feel  comfortable  obtaining  a  service  that  actually 

19  might  be  available  from  a  lab  through  us  than  they  would 

20  going  to  a  lab  directly.    And  the  service  that  is  rendered 

21  might  turn  out  to  be  the  same  if  had  they  gone  directly. 

22  But  we  can  provide  a  buffer  that  provides  a  bunch 

23  of  comfort  ?.nd  a  common  approach  and  understanding  that 

24  they  might  feel  uncomfortable  trying  to  to  do  it  some 

25  other  way. 
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1  MR.  SROUFE:    What  ao  you  expect  to  happen  at 

2  these  open  meetings? 

3  MR.  MACK:    Those  meetings  will  be  really  quite 

4  formal.    There  will  be  prepared  testimony  delivered,  and 

5  we  will  simply  convene  the  meeting  and  folks  who  have 

6  anything  that  they  wish  to  say  for  the  record  or  enter 

7  into  the  record  can  prepare  materials  that  would  be 

8  accepted  at  that  meeting. 

9  It's  an  opportunity  for  not  just  invited  groups 

10  as  yours,  but  for  anyone  to  present  material.    What  we 

11  found  previously  was  that  while  we  got  a  lot  of  useful 

12  information  at  those  meetings,  some  of  it  was  focused  on 

13  very  narrow  issues  that  people  were  concerned  about  and 

14  that  it  was  good  for  us  to  hear  about  those  but  they  —  in 

15  ether  words,  we  expect  that  information  not  to  be  as 

16  focused  as  this. 

17  MR.  SROUFE:     It  xooked  like  an  interesting  idea. 

18  MR.  STALFORD;     By  definition  it's  a  different 

19  structure. 

20  I  appreciate  your  efforts.    I  think  making  a 

21  rational  decision  in  an  irrational  world  is  always  hard. 

22  MR.  MACK:    There  would  be  a  record  of  whatever  we 

23  get  from  that  as  well  as  from  this  and  that  record  will  be 
available  to  you.    Make  sure  that  you  get  a  full  set  of 

25  the  materials  that  are  available  back  here  if  you  didn't 
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get  them  when  you  came  in.    Make  sure  you  get  them  when 
you  leave. 

MR.  STALFORD:    Anything  that  is  not  there  that 
you'd  like  to  have,  we'll  be  happy  to  get  for  you.  Again, 
on  behalf  of  Nelson  and  us,  thank  you  very  much  for 
coming. 

(Whereupon,  at  11:45a.m.,  the  meeting  was 
adjourned  to  reconvene  at  9:00  a.m.,  June  27,  1989.) 
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1  PROCEEDINGS 

(9:00) 

2 

3  MR.  SMITH:    I'm  Nelson  Smith  for  Programs  for  the 

4  improvement  of  Practice,  and  I  want  to  welcome  you  to  the 

5  second  of  two  days  in  which  *e  are  asking  for  the  views  of 

6  associations  and  organizations  about  the  recompetition  of 

7  the  Regional  Educational  Labs.    We  are  going  to  be  having 

8  some  additional  sessions  in  July  for  the  public  here  in 

9  Washington  and  elsewhere 

10  But  this  is  an  opportunity  for  those  who  have 

fairly  well  defined  constituencies  to  cone  and  tell  us  the 
views  of  their  groups  about  this  issue.    As  we  get  started 
this  morning,  it's  a  real  pleasure  for  me  to  introduce  the 
Under  Secretary  of  Education,  Ted  Sanders,  who  has  agreed 
15         to  come  and  open  the  proceedings  this  morning. 

Ted  began  his  career  as  a  teacher  in  Mountain 
Home,  Idaho  and  later  taught  in  a  Navaho  elementary  school 
in  New  Mexico.    He  was  the  assistant  superintendent  of 
instruction  in  New  Mexico  and  from  there  went  to  become 
the  chief  state  school  officer  in  Nevada.    And  after  six 
years  in  that  post,  he  went  to  the  same  post  in  Illinois. 

22  so  he  has  extensive  experience  at  the  chief 

23  level.    He  has  been  president  of  the  Council  of  Chief 

24  State  School  Officers,  president  of  the  Board  of  the  North 

25  Central  Regional  Educational  Laboratory,  and  Vice 
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1  President  of  the  Executive  Committee  of  the  National 

2  Council  for  Accrediting  Teacher  Education.    He  is  a  member 

3  of  the  Board  of  Directors  for  the  Educational  Testing 

4  Serivice,  the  Math  Sciences  Education  Board,  and  the  Board 

5  of  Trustees  for  the  Foundation  for  Excellence  in  Teaching. 

6  So  he  brings  a  rare  combination  of  perspectives 

7  to  the  proceedings  this  morning,  and  it's  a  great  pleasure 

8  to  welcome  the  Under  secretary  of  Education. 
MR.  SANDERS:    Thank  you,  Nelson.    I  really  didn't 

expect  the  introduction  this  morning.    I  come  this  morning 

11  for  one  very,  very  simple  purpose,  and  that  is  hopefully 

12  to  symbolize  for  you  the  importance  of  this  activity  in 

13  which  you're  engaged  this  morning. 

14  Tnis  is  a  rare  opportunity  to  engage  in  a  very 

15  spirited  debate  about  the  regional  laboratories.    I  have 

16  interest  in  those  laboratories  from  a  variety  of 

17  perspectives.    One  as  a  consumer  of  their  products  and 

18  their  activities. 

You  can  see  from  Nelson's  introduction  that  I  had 

a  direct  involvement  not  just  in  one  but  in  several  of  the. 

21  laboratories.    I  had  a  direct  interest  in  three  others  and 

22  either  served  on  the  board  or  in  other  various  capacities 

23  with  respect  to  them. 

24  i  also  had  the  good  fortune  to  work  with  Dave  and 

25  Bill  and  others  several  years  ago  when  the  administration 
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1  was  thinking  through,  again,  the  recompetition  at  an 

2  earlier  time,  the  recompetition  of  regional  laboratories 

3  and  the  centers,  and  I  thought  to  all  intents  that  we 

4  found  all  the  answers  as  we  debated  recompetition  at  that 

5  time. 

6  So  I'm  very,  very  anxious,  personally,  to  hear 

7  the  results  of  your  discussions  today  as  well  as  the  other 

8  spirited  discussions  that  will  take  place  across  the 

9  country  about  the  laboratories  and  their  place  in  the 

10  improvement  of  public  and  private  education  in  our 

11  country. 

12  So  I  welcome  you  and  wish  you  well  for  the  time 

13  that  you'll  spend  today  and  thank  you,  recognizing  that 

14  this  is  a  fairly  significant  commitment  of  time  on  your 

15  part  this  morning,  in  the  preparation  that  you've  done  and 

16  the  contributions  that  you'll  make. 

17  So  I  say  a  very  special  thank  you  on  behalf  of 

18  the  Secretary  and  myself  and  wish  you  well  for  this 

19  discussion.    We're  going  to  listen  carefully  to  what  it  is 

20  that  you  have  to  say  to  us.    Thank  you. 

21  MR.  SMITH:    As  we  did  yesterday,  I'll  just  simply 

22  say  at  the  outset,  although  you've  gotten  a  letter  of 

23  invitation  that  spells  out  some  very  clear  questions  about 

24  how  we  want  to  proceed,  I  expect  that  we'll  go  beyond 

25  those  questions. 
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1  The  floor  is  open  to  any  consideration  that  you 

2  want  to  bring  up  about  the  operation  of  the  structure  of 

3  the  labs.    And  although  we  have  delineated  four  very  clear 

4  areas  of  suggestion,  I  think  that  our  best  charge  this 

5  morning  is  to  go  as  far  in  the  field  as  we  need  to  to 

6  bring  up  any  concerns  that  you  want  to  bring  up. 

7  So  without  further  adieu,  let  me  turn  it  over  to 

8  Charlie  Stalford  to  explain  how  we  are  to  proceed  today. 

9  MR.  STALFORD:    I  think  it  would  be  best  before  we 

10  get  into  the  business  of  this  morning  to  have  a  brief 

11  round  of  introductions  here  for  people  who  were  at  the 

12  table  and  for  those  who  are  in  attendance  also.    We'll  ask 

13  each  of  you  to  do  that  yourselves. 

14  Before  doing  that,  I  do  want  to  recognize, 

15  however,  the  presence  here  of  the  Acting  Assistant 

16  secretary,  Bruno  Manno.    In  the  back  of  room,  who  just 

17  came  in,  is  Arthor  Lowe,  Deputy  Assistant  Secretary  for 

18  Policy  and  Planning.    We're  pleased  to  have  Milt  Goldberg 

19  here  with  us,  Director  of  the  Office  of  Research.    Most  of 

20  you  know  Milt  was  Director  of  Programs  for  the  improvement 

21  of  Practice  previously  and  is  quite  interested  in  the 

22  program. 

23  to  my  right  is  David  Mack,  Directors  of  the 

24  Educational  Networks  Division,  *nd  to  his  right  is  Barbara 

25  Lieb-Brilhart,  a  Team  Leader  for  the  laboratory  program. 
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I'm  the  Team  Leader  for  the  Evaluation  in  the  Educational 

2  Networks  Division,  and  I'm  running  these  processes  that 

3  are  related  to  the  recompetition. 

4  so  with  having  introduced  some  of  the  OERI 

5  people,  may  we  go  around  the  table,  please,  perhaps 

6  starting  with  you,  Gerald,  and  introduce  yourselves  and 

7  then  we'll  have  people  outside  the  table  introduce 

8  themselves  also. 
GERALD  SROUFE:     I'm  Gerald  Sroufe,  I'm  with  the 

AERA,  and  I  was  here  yesterday.    So  I  intend  to  be  quiet, 

11  I've  had  my  day  in  the  sun.    But  I  wai  interested  in 

12  hearing  what  the  rest  of  you  had  to  say. 

MS.  EARLEY:    I'm  Penny  Ear ley,  I'm  with  the 

American  Association  of  Colleges  for  Teacher  Education  and 

I  heard  Gerry  was  going  to  be  quiet  today,  and  I  wanted  to 

16  come  and  see  that. 

17  MS.  STONER:    I'm  Dena  Stoner  with  the  Council  for 

18  Educational  Development  and  Research. 

19  MR.  RHODES:     I'm  Lou  Rhodes  with  the  American 

20  Association  of  School  Administrators. 

21  MR.  STALFORD:    Sitting  next  to  Lou  is  Anne  App 

22  who  is  doing  a  synthesis  of  these  proceedings  for  public 

23  distribution,  and  seated  next  to  Anne  is  Rita  Fhepard  who 

24  will  be  doing  a  verbatim  transcript  which  will  also  be 

25  available  for  public  distribution. 
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1  MS.  DEW ALL:    I'm  Marily  Dewall,  and  I'm  with  the 

2  National  Science  Teachers  Association. 

3  MR.  WARREN:    My  name  is  Carl  Warren.    I'm  an 
intern  at  the  Institute  for  Educational  Leadership  working 

5  with  Mr.  Usdan  and  Ms.  Hale. 

6  MS.  "ALE:    I'm  Betty  Hale  with  the  Institute  for 

7  Educational  Leadership,  and  I  also  work  with  the  National 

8  Leadership  Network.    You  would  be  interested  to  know  that 

9  the  institute  does  not  have  a  constituency  we  have, 
however,  a  generic  interest  in  research  and  its  quality. 

MR.  USDAN:    Mike  Usdan  with  the  Institute  for 
Educational  Leadership,  and  I'm  intrigued  that  the  inner 
13         ring  seems  to  be  outnumbered  by  the  outer  ring. 

MR.  STALFORD:    If  I  may,  this  is  for  my  benefit 
as  well  as  anybody  else,  there  is  some  ambient  noise  in 
the  ceiling  here.    Not  only  for  those  of  you  at  the  table 
but  as  you  introduce  yourself  from  outside,  if  you  could 
speak  up  so  we  could  be  sure  to  get  your  names,  please. 

(In  addition  to  the  people  above  mentioned,  other 
members  of  the  OERI  staff  and  various  associations  and 

21  organizations  were  introduced.) 

22  MR.  STALFORD:    Thank  you  very  much.    Because  this 
proceeding  is  related  to  a  pending  procurement,  I  want  to 
actually  read  a  short  statement  that  will  set  forth  the 
ground  rules,  as  it  were,  for  what  we  can  do  here  and  the 
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1  nature  of  the  conversation  we  can  have  and  that  we  are  not 

2  going  to  have,  for  your  benefit  and  for  the  benefit  of 

3  everyone  who  has  an  interest  in  this  competition. 

4  This  meeting  is  one  of  two  being  held,  the  other 

5  held  yesterday,  to  obtain  the  views  of  education 

6  associations  and  other  organizations  representing  major 

7  educational  constituencies  involving  the  work  in  the 

8  future  of  the  Regional  Educational  Laboratories. 

9  Associations  and  organizations  which  have  been  invited  to 

10  be  represented  at  this  meeting,  but  who  are  not  present 

11  today,  or  who  were  not  yesterday,  will  have  the 

12  opportunity  to  submit  written  statements  to  OERI  directly 

13  regarding  the  issues  that  we  will  be  discussing  today. 

14  These  two  meetings  are  not  the  only  opportunity 

15  to  provide  input  to  OERI  regarding  the  recompetition. 

16  OERI  will  hold  three  open  meetings  in  July  at  which 

17  members  of  the  public  can  express  their  views  about  the 

18  lab  program  for  the  recompetition. 

19  Tnese  meetings  will  be  held  on  July  19th  in 

20  Washington  and  Kansas  City,  and  July  21st  in  San 

21  Francisco.    Members  of  the  public  who  wish  to  make  a 

22  statement  to  OERI  but  are  unable  to  attend  any  of  these 

23  meetings  may  also  submit  written  statements  directly  to 

24  us.    Written  statements  from  either  these  meetings  or  the 

25  July  meetings  should  be  sent  to  us  by  July  21st. 
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1  Details  about  these  meetings,  how  to  submit 

2  statements  to  OERI  and  other  information  about  the  lab 

3  program  and  a  recompetition  are  contained  in  a  notice 

4  published  by  the  Federal  Register  last  Friday,  and  a  copy 

5  of  that  notice,  as  printed,  is  on  the  table  in  the  back  o: 

6  this  room. 

7  The  issues  that  OERI  wishes  to  receive  views 

8  about  from  association  and  organization  representatives 

9  these  two  days  of  meetings  are  contained  in  the  letters  o 

10  invitation  to  those  of  you  who  were  invited  and  are  also 

11  found  in  the  the  Federal  Register  notice.    I'll  go  over 

12  these  briefly  before  we  begin. 

13  The  purpose  of  these  meetings  is  for  OERI  to 

14  learn  the  individual  views  of  representatives  of 

15  associations  and  organizations  about  these  issues, 

16  particularly  regarding  the  view  points  of  the 

17  contituencies  they  represent. 

18  The  purpose  is  to  obtain  consensus  views  cn  any 

19  of  those  issues.    OERI  will  seriously  consider  views 

20  expressed  here  and  through  other  means  described 

21  previously.     But  its  receipt  of  these  views  doesn't  mean 

22  that  OERI  endorses  any  of  them  or  that  they  will  be 

23  necessarily  reflected  in  policies  regarding  the 

24  recompetition  or  the  solicitation  itself. 

25  Following  this  introduction  and  a  short  period 
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for  any  questions  and  answers  which  you  may  have  about  it, 
we  will  ask  association  and  organization  representatives 
to  comment,  individually,  on  issues  in  the  letter.  You 
4         may  also  raise  issues  related  to  the  program  other  than 

those  that  may  be  on  your  mind  as  Nelson  indicated  before. 

Acting  as  chair,  and  other  people  in  OERI  may 
enter  into  this  discussion  as  well,  I  or  we  may  ask  those 
of  you  presenting  any  views  to  elaborate  or  otherwise 
clarify  those  ideas  as  appropriate.    However,  neither  I 

10  nor  anyone  else  from  OERI  will  engage  in  any  sort  of 

11  discussion  which  has  the  appearance  or  would  actually 

12  result  in  OERI  making  an  agreement  or  effectively 

13  negotiating  about  the  terms  of  the  solicitation,  which 

14  would  not  be  appropriate. 

15  as  announced  in  the  Federal  Register,  the  public 
has  been  invited  to  attend  and  listen  to  the  discussion  at 
these  meetings  and  the  public  will  have  the  opportunity 
again  to  present  views  in  July.    Therefore,  this  meeting 
is  not  set  up  for  public  input,  but  the  public  in 
attendance  may  listen  and  learn  about  the  views  expressed 

21  here. 

22  The  synthesis  and  transcripts  of  these  meetings 
will  be  available  as  soon  as  possible,  which  I  anticipate 
will  be  in  mid-July.    There  are  on  the  tables  in  the  back 
of  the  room,  most  of  you  have  seen,  copies  of  commissioned 
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1  policy  papers  which  we  had  prepared  under  contracts  to 

2  help  our  thinking  about  the  recompetition,  and  a  display 

3  copy  of  the  document  synthesizing  information  about  the 
laboratory  program  the  first  two  years.    There  is  also  a 

5  listing  of  those  publications  there. 

6  If  you  would  like  any  that  you  don't  want  to 

7  carry  home  or  if  you  would  like  a  copy  of  the  synthesis, 

8  please  put  your  name  and  address  on  one  of  those  forms  and 

9  leave  it  with  us. 
There  are  two  purposes  for  making  these  documents 

11  available  to  the  public,  there  are  two  purposes.    First  is 

12  to  enhance  public  understanding  about  the  lab  program  and 

13  the  significance  of  the  recompetition  which  will  be  held 

14  in  1990.    The  second  purpose  is  to  encourage  preparation 

15  of  the  highest  quality  proposals  possible  from  the 

16  recompetition,  nonincumbents  and  incumbents  alike. 

17  Those  present  today,  and  anyone  else  who  makes  a 

18  request  can  have  their  name  placed  on  an  OERI  mailing  list 

19  to  receive  any  and  all  of  these  documents,  notice  of 
future  events  of  the  recompetition,  copies  of  the 
solicitation  and  proposals  itself,  and  an  announcement  of 

22  the  outcome  of  the  recompetition. 

23  oERI  is  committed  to  a  free  flow  of  information 

24  regarding  the  recompetition  with  a  firm  belief  that  it  is 
both  in  the  public  interest  and  the  long  term  viability  of 
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1  the  lab  program. 

2  Before  we  begin  I'll  answer  any  questions  about 

3  the  invitations  to  the  meeting  or  documentations  about 

4  this  meeting  and  the  processes.    Does  anyone  have  any 

5  questions,  procedural  questions  at  this  time? 

6  Again  we  wish  to  express  our  appreciation  for 

7  members  of  the  the  OERI  management  here,  including  the 

8  Under  Secretary.    With  no  further  ado,  perhaps,  for  the 

9  benefit  of  at  least  some  who  are  in  the  audience,  I  wiil 

10  briefly  go  over  the  four  issues  that  were  in  the  letters 

11  of  invitation  to  those  of  you  seated  here  at  the  table. 

12  The  first  one  was  what  activities  conducted  by 

13  Regional  Educational  Laboratories  have  been  most  valuable 

14  as  to  your  constituency  in  the  past  two  to  three  years? 

15  Second,  what  are  the  key  educational  issues 

16  laboratories  should  focus  on  in  the  future? 

17  Third,  what  kinds  of  activities  and  strategies, 

18  for  example,  sytheses  and  other  R&D  products,  direct 

19  technical  assistance,  capacity  building  and  the  like  would 

20  most  benefit  your  constituency  in  the  future? 

21  Finally,  what  form  of  laboratory  relationships 

22  with  your  contituency,  for  example,  centralized  or 

23  decentralized,  formal  or  informal,  contractual  or  not, 

24  what  form  of  relationships  would  be  most  effective  in  the 

25  future? 
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1  There  are,  indeed,  lots  of  other  issues  that  can 

2  be  discussed,  but  those  that  appear  to  us  to  be  the  most 

3  vitall,  but  others  may  come  to  mind.    So  we  solicit  your 

4  views.    The  table  is  open  for  comments  on  those  or  others 

5  related  to  them. 

6  MR.  SMITH:    Looking  around  the  table,  I'm 

7  thinking,  perhaps,  we  have  people  whose  "contituencies" 

8  are  not  the  same  kind  of  constituencies  we  had  yesterday. 

9  Maybe  a  sort  of  general  opening  statement  might  be 
10  appropriate  from  folks  around  the  table, 

n  Betty,  you're  nodding  your  head,  would  you  like 

12  to  kick  off? 

13  MS.  HALE:    One  of  the  things  I  was  curious  about 

14  was,  perhaps,  a  fifth  question  which  would  be  of  interest 

15  to  me  which  would  have  to  do  with  the  vision  from  the  U.S. 

16  Department  of  Education  with  respect  to  all  of  its  sort  of 

17  research  or  "research  activities,"  how  are  they  going  to 

18  fit  together?    And  it  seems  to  me  that  is  something  that 

19  we  ought  to  be  thinking  about.    What  is  going  to  be  the 
relationship  between  the  laboratories  and  the  centers  and 
the  two  new  centers  and  all  of  the  various  sorts  of  things 

22  that  you're  funding? 

23  MR.  SMITH:    That  is  a  good  question,  and  that 
permeates  the  whole  dialogue  about  the  recompetition  of 
the  labs  and  the  other  portions  of  the  system.    Do  you 
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1  have  your  own  view  that  you'd  like  to  volunteer  about  what 

2  sort  of  relationship  or  at  least  what  portion  of  that 

3  overall  relationship  the  labs  ought  to  occupy? 
MS.  HALE:    I'm  not  sure  I  have  any  hard  and  fast 

5  notion  of  it.    As  I  was  coming  here  this  morning,  I 

6  started  thinking  that  you  have  all  these  researchers  in 
universities,  and  I  don't  pretend  to  understand  or  know 
all  of  what  they're  trying  to  do,  I  just  know  that  a  lot 
of  people  are  doing  a  whole  lot  of  research.    I  don't  know 
how  and  that  independent  researchers  are  doing  ever  gets 
into  the  pipeline.    How  does  all  of  that  get  fed  into  the 

12  ERIC  system? 

13  It  seems  to  me  that  there  is  a  whole  lot  going  on 

14  out  there,  and  yet,  the  federal  government's  education 

15  research  agenda,  a  lot  of  those  dollars  go  through  the 

16  labs  and  centers,  and  I'm  curious  about  what  we  s«e  as  how 

17  we  want  to  put  all  that  together. 

I  don't  have  any  problem,  also,  sitting  here  and 

saying  that  I  think  that  there  are  couple  of  big  issues 
which  have  to  do  with  totally  different  organizations  and 
how  do  we  prepare  people  to  work  in  totally  different 
organizations.    I  think  £he  leadership  requirements  are 
very  different.    So,  I  mean,  I  can  also  talk  about  some  of 
the  things  that  we  at  the  institute  would  think  ought  to 
25         be  on  any  research  agenda. 
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1  MR.  SMITH:    When  you  say  totally  different 

2  organizations,  you  mean  the  new  entities  that  we  ought  to 

3  be  thinking  about  creating  or  the  organizations  people 

4  will  be  working  in  the  future? 

5  MS.  HALE:    People  are  running  around  talking 

6  about  how  they're  going  to  restructure  the  schools,  they 

7  want  to  do  more  school  improvement,  they  want  to  do  more 

8  on  Science  and  Math.    And  I  think  that  those  are  the  same 

9  issues  that  are  confronting  the  private  sector,  and  it  is 

10  the  business  about  helping  workers  reclaim  their  work 

11  environment,  what  do  we  do  about  our  teaching  force? 

12  I  think  there  are  a  lot  of  issues,  and  I  don't 

13  understand  enough,  I  guess,  about  sort  of,  do  the  labs 

14  have  a  concrete  agenda  or  is  it  sort  of  up  for  grabs? 

15  That  might  be  an  interesting  place  to  star*      Who  decides 

16  what  research  the  labs  are  going  to  do?    How  io  they 

17  decide  it? 

MR.  SMITH:    That  is  one  of  the  questions  I  think 


18 

19  which  —  we've  worked  our  way  back  to  our  list  here 

20  because  one  of  the  questions  has  to  do  with  who  decides. 

21  We,  as  you  may  know,  in  1985,  created  a  certain  governance 

22  to  the  labs  and  their  agendas  are  set  by  the  governing 

23  awards  which  include  chief  state  school  officers  and 

24  others. 

25  one  of  the  questions  on  the  agenda,  I  think,  is 
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1  the  question  of  governance  and  the  question  of  to  what 

2  extent  the  federal  government  does  and  should  influence 

3  what  the  laboratories  do. 

4  Maybe  we  could  ask  some  of  the  other  folks  here 

5  representing  the  constituencies,  as  it  were,  Penny,  for 

6  example.    The  teacher  educators,  is  there  a  feeling  out 

7  there  among  them  about  the  nature  of  activities  the  labs 

8  have  been  carrying  on  or  their  role  in  the  system? 

9  MS.  EARLEY:    As  a  matter  of  fact,  there  is  a 

10  feeling.    Since  our  membership  is  public,  private,  large, 

11  small  institutions  of  higher  education,  you  might  imagine 

12  it  would  be  correct  that  the  feelings  are  not  exactly 

13  uniform. 

14  But  overall,  our  members  have,  in  most  regions, 

15  worked  quite  successfully  with  the  laboratories.     In  one 

16  instance  in  one  laboratory  our  state  affiliates  worked  in 

17  to  the  proposal  that  was  funded  for  that  laboratory  as  a 

18  way  of  making  the  tie  between  the  research  that  happens  at 

19  universities,  particularly  the  research  that  is  university 

20  based  but  not  center  supported,  and  then  the  laboratory. 

21  0ne  0_  the  nice  pieces  in  the  lab  and  center 

22  configurations  that  I  think,  perhaps,  we  haven't  looked  at 

23  closely  in  past  years  is  the  original  concept  that  the 

24  centers  would  do  the  basic  kinds  of  empirical  research  and 

25  that  the  laboratories  worked  closely  with  them  and  be 
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1  their  dissemination  arm.    I  think  those  distinctions  over 

2  the  years,  they  haven't  been  blurred.    But  we  haven't  paid 

3  as  close  attention  to  them  as  we  might. 

4  In  terms  of  the  higher  education  community,  they 

5  see  themselves  very  much  as  a  link  between  the  kind  of 

6  research  that  is  occurring  in  the  institutions.    But  much, 

7  much  research  is  school  based,  lots  of  it  is  school  based 

8  and  not  at  all  limited  to  what  happens  in  institutions  of 

9  higher  learning. 

10  But  they  are  a  link  between  the  research  that 

11  goes  on  institutionally,  the  research  that  goes  on  in  the 

12  schools  and  is  done  by  faculty  members  and  serious 

13  researchers,  and  then  the  laboratories  as  the 

14  dissemination  piece.    They're  also  consumers  of  laboratory 

15  materials.    Not  so  much  in  terms  of  their  own  research, 

16  but  in  terms  of  preparing  individuals  to  go  into  the 

17  classrooms.     In  that  sense  they  become  consumers  of 

18  research  that  goes  to  the  various  lab  networks.    So  in 

19  many  ways  they're  tied  very  closely  with  what  happens  in 

20  the  laboratories. 

21  In  one  region,  for  example,  there  is  a  formal 

22  relationship.    In  several  others,  there  is,  as  part  of  the 

23  government  structure,  involvement  of  higher  education  and 

24  particularly  schools  of  education  in  the  governance  of  the 

25  laboratories,  and  then  in  some  of  them  it's  a  much  more 
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1  professional,  collegial  kind  of  relationship  where  it  is 

2  not  specified.    But  it  occurs  anyway  just  because  of  the 

3  nature  of  the  individuals  who  are  involved. 

4  On  one  hand  I  think  there  is  merit  for 

5  encouraging  certain  kinds  of  ties  and  relationships  that 

6  might  involve  higher  education  and  allowing  higher 

7  education  to  be  seen  as  one  of  the  linkages,  the  link 

8  between  what  happens  in  the  centers  and  particularly  what 

9  happens  in  the  labs,  and  also  what  happens  in  the  use  of 

10  the  ERIC  system. 

11  Our  people  are,  as  you  would  expect,  big 

12  consumers  and  users  of  ERIC  in  the  teacher  preparation 

13  program  and  they  train  the  people  who  are  going  to  be 

14  teachers  in  the  utilization  of  the  ERIC  system. 

15  so  there  are  a  number  of  points  where 

16  institutions  of  higher  education  touch  the  various  pieces, 

17  and  I  like  the  idea  of  the  linkages.    The  issue  that  I 

18  think  is  a  fundamental  one  is  whether  or  not  that  is 

19  something  that  should  be  prescribed  or  whether  or  not 

20  something  that  should  be  encouraged  or  whether  it's 

21  something  we're  just  silent  about  and  hope  that  it  would 

22  occur. 

23  i  suspect  in  terms  of  my  membership  we  would  fall 

24  somewhere  between  strongly  encourage.    But  I'm  not  certain 

25  we  would  really  be  strong  endorsers  prescribing  certain 
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1  kinds  of  arrangements 

2  In  general,  our  organization  is  one  that  gets  a 

3  little  bit  nervous  when  what  we  see  is  overregulation  from 

4  anybody,  federal,  state,  or  other.    But  we  do  like 

5  instances  within  government  where  certain  kinds  of 

6  relationships  that  are  proven  to  be  positive  and  are 
useful  in  particularly  link-various  sectors,  K-12,  higher 
education,  state  government,  federal  government,  and  so 
on,  where  those  kinds  of  relationships  are  encouraged. 

MR.  SMITH :    Before  we  go  on,  let  me  ask  our  new 

11  arrivals  to  introduce  themselves. 

12  mr.  BRIGHAM:    Frederick  Brigham,  National 

13  Catholic  Education  Association. 

14  MS.  THOMAS :    Adria  Thomas,  National  School  Boards 

15  Association. 

16  MR.  SMITH:    Penny,  you  touched  on  something  which 

17  we  discussed  at  some  length  yesterday  and  that  is  the  fact 
that  the  laboratories  are  part  of  this  larger  arrangement 
and  one  other  major  sector  is  the  research  centers,  and 
your  constituents  work  with  both.    Could  you  address  a 
little  bit  the  question  of  the  difference  between  the  role 
they  might  play  with  centers  and  the  role  they  might  play 
with  the  labs?    Is  it  a  question  of  research  versus 

24  applied  research  or  research  versus  dissemination? 

25  MS.  EAR1EY:    It  probably  breaks  down  more  along 
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1 

the  dissemination,  although  I  don't  think  those  lines  are 

2 

that  clear.    I  think  it  is  mere  a  situation  where 

3 

universities  that  are  going  to  work  with  people  that  are 

4 

doing  interesting  work  and  reasonable  work  and  have  both 

5 

opportunities  to  advance  knowledge  and  to  share  knowledge. 

6 

One  of  the  distinctions  we  tend  to  make  in  our 

7 

membership,  and  I  will  say  it's  an  organizational 

8 

distinction  we  make,  I'm  not  certain  all  of  our  members 

9 

would  see  this  distinction,  it's  between  the  research 

10 

generating  institutions  and  the  research  utilization 

11 

institutions. 

12 

The  research  generating  institutions  would  be  a 

13 

place  like  Michigan  State  which  clearly  is  in  the  process 

14 

or  business  of  knowledge  production  as  well  as  being  a 

15 

practitioner,  preparation  school.    Keeping  in  the  same 

16 

state,  Western  Michigan  University  or  Eastern  Michigan 

17 

University  are  practitioner  preparation  schools  and  they 

18 

don't  have  the  heavy  research  emphasis  that  a  place  like 

19 

Michigan  State  or  the  University  of  Michigan  would  have. 

20 

So  for  us,  the  centers,  perhaps,  are  more 

21 

oriented  to  the  kinds  of  activities  that  can  go  in,  or 

22 

that  will  occur,  in  the  knowledge  production  side  of  our 

23 

business.    And  more  often  than  not  you'll  see  that  cluster 

24 

in  places  that  are  the  research  type  institutions; 

25 

although  one  of  the  things  we  are  doing  is  encouraging 

ERIC 
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1  relationships  between  these  different  types  of 

2  institutions,  and  our  memberships. 

3  So  the  kinds  of  research  that  are  being  done  at  a 

4  place  like  Michigan  State  may  be  tied  either  in  a  formal 

5  or  informal  way  with  activities  that  are  going  on  in  one 

6  or  more  of  the  knowledge  utilization  type  schools. 

7  With  respect  to  the  laboratories,  I  suspect  that 

8  the  relationships  are  closer  to  those  institutions  that 

9  are  more  the  knowledge  utilization  places.    They  are  the 

10  ones  that  are  taking  the  work  that  is  being  done  at 

11  Michigan  State  or  teachers'  colleges  and  the  various,  both 

12  federally  funded  and  nonfederally  funded,  research 

13  centers,  and  they're  trying  to  change  their  curriculum  and 

14  modify  the  teacher  preparation  work  as  well  as  looking  at 

15  how  this  is  going  to  inform  what  happens  in  schools  and 

16  what  are  the  implications  of  that  preparation  of  teachers. 

17  The  lab  forms  part  of  the  link  between  what  happens  in  the 

18  centers  and  what  happens  in  these  other  types  of 

19  institutions. 

20  So  for  us  it  really  isn't  that  easy  of  a  question 

21  because  of  the  diversity  of  the  types  of  institutions  that 

22  are  known  as  teacher  preparation  schools  and  the  different 

23  missions  that  they  have. 

24  MR.  SMITH:    Let  me  ask  you  a  question  about  the 

25  teachers  that  are  educated.    Can  you  tell  me  what 
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1  purportion  are  actually  educated  in  state  colleges  of 

2  teacher  education  as  opposed  to  a  place  that  will  send 

3  teachers  out  beyond  the  borders  of  the  state. 

4  MS.  EARLEY:    I  thought  you  were  asking  one 

5  question,  but  I  think  you  were,  maybe,  asking  me  another 

6  and  I  want  to  get  a  clarification.    Are  you  asking  me  the 

7  numbers  of  teachers  that  are  prepared  in  research  type 

8  institutions  versus  state  colleges  or  private  schools,  or 

9  are  you  asking  me  what  proportion  of  teachers  will  stay, 

10  MR.  SMITH:    Let  me  ask  the  next  question.  What 

11  I'm  getting  at  is  the  relationship  of  the  laboratories  to 

12  the  states.    In  other  words,  one  of  their  missions  is  to 

13  assist  the  states  in  those  areas  such  as  teacher 

14  preparation.    Do  they  succeed  in  doing  that?    Can  you 

15  comment  on  that  in  perspective  of  institutions  that  are 

16  supposed  to  be  serving  the  needs  of  a  given  state? 

17  MS.  EARLEY:    I  can  speak  in  a  sense  of  what  would 

18  be  essentially  a  key  study  basis,  and  that  is  the  feedback 

19  I've  had  from  my  membership. 

20  Particularly  I  would  say  the  practitioner 

21  preparation  type  schools,  especially  that  have  good 

22  relationships  with  their  laboratories  and  use  the 

23  laboratories  as  a  source  of  information  that  prepare 

24  teachers. 

25  As  it  happened  last  week,  I  was  talking  with  the 
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1  Dean  at  Idaho  State  who  has  an  especially  good 

2  relationship  with  the  Horthwest  lab  and  uses  the  products 

3  of  the  lab  to  work  into  their  teacher  preparation  program. 

4  How  many  of  those  teachers  go  beyond  Idaho  that  they 

5  prepare,  I  don't  know  that.    That  is  a  different  kind  of 

6  question  and  that  suggests  information  that  we  don't 

7  happeii  to  have. 

8  I  think  the  source  of  relationships,  however,  are 

9  in  a  sense  born  of  institutional  and  individual 

10  personality  traits.    If  you  have  an  institution  that  is 

11  committed  to  working  with  the  schools  as  part  of  its 

12  mission,  is  committed  to  outreach  in  the  state,  is 
committed  to  thinking,  maybe,  in  a  visionary  sense  about 
what  we  call  simultaneous  renewal  of  both  the  schools  and 

15  teacher  education  programs,  those  are  going  to  be  the 

16  institutions  that  will  be  more  likely  to  form 

17  relationships  with  entities  such  as  the  laboratories. 

18  Other  institutions  see  their  missions  somewhat  more 

19  •      narrowly,  and  those  are  ones  who  might  be  less  likely  to. 

It  would  be  the  hope  of  an  organization  such  as 

mine  that  the  bulk  of  our  members  would  be  the  ones  who 

22  would  see  the  opportunities  in  entities  such  as  the  labs, 

23  ERIC  system,  t>  «s  centers,  all  of  the  OERI  funded 

24  operations. 

25  MS.  HALE:    Nelson,  do  you  have  data,  sort  of  a 
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1  public  opinion  poll  as  it  were,  on  how  many  people  know 

2  that  the  labs  exist? 

3  MR.  SMITH:    We  have  something  like  that.  Maybe 

4  Charlie  could  describe  our  survey. 

5  MR.  STALFORD:    We  have  near  completion  the  study 

6  done  through  the  department's  Fast  Response  Survey  System 

7  of  the  National  Center  of  Education  Statistics,  which  is  a 

8  survey  of  the  receipt  and  degree  of  use  of  various  R  &  D 

9  resources  by  school  districts  from  laboratory  centers, 

10  ERIC  clearinghouses,  and  National  Diffusion  Network 

11  Facilitators. 

12  The  survey  also  has  a  needs  analysis  type  of 

13  question  in  it  which  asks  the  districts  to  prioritize  the 

14  areas  in  which  they  will  most  need  assistance  in  the 

15  future.    I  think  in  a  quite  interesting  way  it  has  an 

16  open-ended  question  which  says  tell  us  about  —  name  a 

17  particularly  valuable  R&D  resource  from  anywhere,  and 

18  what  was  the  topic. 

We  have  a  very  early  draft  of  that  survey  from 

NCES.    The  second  draft  will  be  ready  for  distribution 


19 


20 


21  with  the  labo  shortly,  and  we  can  discuss  it  at  that  time. 

22  I'd  say  this,  Betty,  a  couple  of  things  about  it. 

23  As  a  sort  of  screening  question,  the  questionaire  asked 

24  whether  you  know  who  these  organizations  are.    That  isn't 

25  why  we  did  the  survey.    But  we  wanted  to  stop  them  from 
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1  answering  questions  about  things  if  they  didn't  know  who 

2  we  were  talking  about.    So  in  effect,  we  got  data  on  that 

3  issue  as  well. 

4  We  did,  as  a  matter  of  procedure,  list  all  the 

5  labs  and  the  centers  on  the  survey  tc  facilitate 

6  recognition  and  minimize  confusion.    I  don't  recall  what 

7  the  numbers  were. 

8  But  I  think  there  is  a  fairly  healthy  percentage 

9  of  people  who  recognized  the  laboratories.    I  just  don't 

10  recall  the  numbers  for  the  other  programs.  We'll  have 

11  information  cn  that  shortly.    We  have  not  had  information 

12  of  that  sort,  really,  before.    I  think  many  years  ago 

13  there  was  a  survey  done  by  the  General  Accounting  Office 

14  which  may  have  come  and  provided  somewhat  of  the  same 

15  information.    But  this  one  has,  the  Fast  Response  Survey 

16  System  frequently  does  have  a  response  rate  of  95  percent 

17  or  so  for  at  least  the  closed-end,  multiple  choice  types 

18  of  questions. 

19  so  we'll  have  pretty  good  information  about  that, 

20  subject  to  the  limitation  it's  a  one-page  survey  and  there 

21  is  always  a  chance  for  misinterpretation. 

22  MS.  LIEB-BRILHART:    One  thing  under  the  current 

23  contract  scope  of  work  under  which  the  labs  are  operating 

24  is  that  they're  working  with  an  indirect  service  strategy 

25  where  they  select,  along  with  their  boards,  the  kinds  of 
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1  service  providers  they're  going  to  work  with  in  the 

2  region.    I  think  one  would  not  expect  that  everybody  in 

3  the  region  would  necessarily  recognize  the  lab.    But  we 

4  would  expect  those  service  providers. 

5  MR. STALFORD:    That  is  true,  the  school  district 

6  is  not  the  primary  client  in  many  respects  for  the  labs  so 

7  results,  even  if  positive,  need  to  be  placed  in  that 

8  context  in  order  to  understand  them. 

9  MR.  US DAM:    I  have  a  question.    I  have  a  general 

10  question.    I  think  it's  kind  of  relevant  to  future 

11  planning  and  it  relates  to  the  indirect  service  strategy 

12  which  you  implemented  in  1985,  and,  obviously,  it's  had 

13  four  years  to  kind  of  work  out. 

14  According  to  the  last  sentence  in  your  fact 

15  sheet,  the  various  strategies  for  the  delivery  of  the  lab 

16  will  be  reconsidered  as  part  of  the  planning  for  the 

17  recompetition.    Does  this  mean  that  you're  kind  of 

18  attempting  to  reconcile  the  pre  '85  strategy  where,  again, 

19  you  had  the  large-scale  product  development  prior  to  the 

20  intermediate  delivery-system  strategy  or  kind  of  a  degree 

21  of  satisfaction  or  dissatisfaction?    I  ask  this  as  kind  of 

22  a  casual  observer  of  the  world? 

23  MR.  SMITH:    It  means  that  we're  open  for 

24  discussion  on  all  of  the  above.    There  is  no  particular, 

25  at  this  point,  leaning  towards  reconciling  the  later  with 
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1  the  earlier.    But  we  are  looking  for  a  lot  of  views,  ani 

2  we've  had  a  lot  of  comments  about  the  indirect  service 

3  strategy. 

MR.  MACK:    It's  a  question  that  during  the  three 
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5  and  a  half  years  or  so  of  this  contract,  OERI  has 

6  maintained  a  group  as  to  advise  the  Assistant  Secretary  on 
the  management  of  the  laboratory  program.    In  total,  and 
as  part  of  their  study,  they  have,  in  fact,  raised  a 
question  about  the  indirect  service  strategy,  and  that  is 
one  of  the  reasons  that  it  was  inserted  there  as  one  of 

11  the  items  that  might  be  considered. 

12  MR.  STALFORD:    I  would  say  this,  that  my 

13  understanding  of  the  history  of  it  is  that  it  wasn't  a 

14  total  revolution  of  the  program  in  1985.    To  varying 

15  degrees,  different  laboratories  had  engaged  in  that  sort 

16  of  delivery  strategy  before;  although  over  time  the 

17  emphasis  on  product  development  went  down. 

As  we  said,  the  Laboratory  Review  Panel  has 

commented  on  that  strategy  and  both  of  its  reports  have 
been  submitted  to  to  the  Assistant  Secretary,  both  copies 
of  those  reports  are  available  here  at  the  table,  in  1987, 

22  and,  again,  this  spring. 

23  as  Nelson  said,  the  table  is  open.    I  would  just 
say  that  among  the  issues  that  have  been  raised  by  the 
panel  is  the  fact  that  it  is  designed  to,  and  does  in  many 
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1  ways,  leverage  the  services  of  a  small  number  of 

2  institutions  who  otherwise  are  not,  except  by 

3  disseminating  lots  of  products,  certainly  able  to  serve 

4  directly  thousands  of  school  districts. 

5  On  the  other  hand  it  has  raised  questions  about 

6  the  evaluation  of  the  laboratories'  work  because  as 

7  Barbara  implied,  it's  hard  to  even  be  recognized  in  some 

8  cases,  at  least  at  the  school  district  level.     If  you  had 

9  provided  information  that  kind  of  has  its  identity 

10  submerged. 

11  so  that  matter  is,  indeed,  open  for 

12  consideration. 

13  MR.  SMITH:    Do  you  ha/e  some  notion  about  that? 

14  Do  you  want  to  volunteer?    In  other  words,  despite  your 

15  lack  of  a  constituency,  which  we  don't  hold  against  you  — 

16  MR.  US DAN:    And  lack  of  very  specific  knowledge 

17  about  these  issues  I  might  add  to  it. 

18  MR.  SMITH:    If  were  you  going  tc  set  out  to 

19  design  some  sort  of  system  to  serve  the  needs  of  people  at 

20  the,  let's  say,  the  school  district  level  with  some 

21  combination  of  technical  assistance  or  services,  what  have 

22  you,  what  would  your  thoughts  be  about  how  that  ought  to 

23  look? 

24  MR.  US DAN:    Well  instinctively  and  intuitively  I 

25  favor  the  kind  of  direction  you  moved  in  in  '85.    I  think 
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1  it  makes  sense  politically  and  substantively  in  terms  of 

2  reaching  the  field. 

3  Again,  I  don't  know  the  nuances,  political 

4  nuances,  I  don't  know  what  the  operational  pluses  and 

5  minuses  of  these  strategies  have  been.    I  think  it  makes 
5  common  sense. 

7  I  think  the  problems  of  research  diffusion  and 

8  brokering  the  information  from  the  universities,  as  Penny 

9  said,  the  information  generating  places,  it  remains  a 
terrible  problem.    There  is  very  little  currency  in  any 

11  professional  field  in  terms  of  the  people  who  spend  their 

12  lives  as  brokers,  if  you  will,  translating  the  research 

13  into  the  field  into  practice.    That  is  a  rare,  very 

14  courageous  breed,  and  they  find  they  have  great  difficulty 

15  gairing  currency  either  in  school  systems  or  in 

16  universities,  and  that  remains  the  prime  dilemma.    I'm  not 

17  not  terribly  sanguine  about  the  university  solving  this 

18  reward  system. 

19  My  own  general  comment  would  be  that  whatever  the 

20  federal  government  can  do  in  terms  of  devising  a 

23         combination,  maybe  it's  the  pre  '85  and  the  post  '85 

22  strategy  that  basically  will  reward  institutions,  be  they 

23  teacher  education  institutions,  state  education  agencies, 

24  intermediaries  of  any  kind  that  basically  will  reward  the 

25  people  and  reward  the  institutions  that  perform  the 
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1  brokerage  function  effectively  because  nobody  else  is 

2  doing  them  or  understanding  them. 

3  Again,  the  rhetoric  is  easier  than  the 

4  implementation,  and  I'm  aware  of  that.    That  is  about  the 

5  extent  of  my  wisdom  on  the  topic. 

6  MS.  HALE:    I  think  one  thing  that,  I  mean,  assume 

7  i!or  the  moment  that  I  dir-cted  one  of  these  regional 

8  laboratories,  and  I  thought  I  wanted  to  try  to  serve 
better.    I  think  we  may  be  talking  to  the  wrong  people  to 
find  out  how  to  serve  people  who  are  in  the  field. 

It  might  make  some  sense  to  think  about  a  couple 

12  of  focus  group  conversations,  Nelson,  with  a  series  or  a 

13  group  of  opinion  leaders  who  are  among  the  ranks.    One  of 

14  the  things  we  know  is  about,  sort  of,  you  know,  the  role 
that  one  or  two  teachers  may  play  in  a  particular  system. 
And  it  could  be  very  fruitful  to  have  that  conversation 

17  that  says,  you  know,  how  do  you  get  your  information,  how 

18  do  you  know? 

19  The  reason  I  asked  the  question,  it  goes  beyond 
name  recognition.    It's  people  beginning  to  feel  that  they 
know  about  resources.    Where  can  I  turn  for  help,  where  is 

22  the  equivalent  of  the  800  number  if  I  have  some  issues 

23  that  I'd  like  to  have  resolved? 

24  we  know  people  are  out  there  generating 

25  information  and  coming  up  with  bright  ideas  and  new 
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1  strategies  that  could  be  put  into  practice.  Real 

2  challenges  to  make  sure  that  information  gets  to  the  right 

3  people . 

4  MR.  SMITH:    That  is  a  nice  idea.    We  are,  as 

5  Charlie  mentioned,  going  to  be  having  these  sessions  next 

6  month  which  will  be  for  public  comment.    But  they  will  be 

7  somewhat  more  structured  than  that. 

8  Maybe  since  we  have  around  the  table  science 

9  teachers,  and  school  administrators,  and  school  boards, 

10  maybe  we  can  pose  the  same  question  that  was  in  the  Fast 

11  Response  Survey  of  are  your  people  aware  of  the  regional 

12  labs?    Do  they  receive  goods  and  services  from  them?  Can 

13  those  goods  and  services  be  characterized?    Can  you 

14  comment  on  that  portion  of  the  question?    Is  your 

15  constituency  actually  aware  of  the  operations  of  the  lab, 

16  are  they  served  by  them,  and  how  could  you  characterize 

17  that  service? 

18  MR.  RHODES:     I  suffer,  I  think,  from  too  much 

19  information  about  the  labs,  and  I'm  trying  to  keep  a  focus 

20  becaus  '  I've  just  come  from  a  meeting  with  urban 

21  superintendents  looking  at  the  politics  of  urban  reform 

22  and  asking  myself  the  question  in  all  of  our  discussion 

23  for  five  days,  did  research  show  up?    Some  of  the  research 

24  was  funded  by  one  of  your  centers  and  research  wasn't 

25  talked  about  too  much  in  terms  of  how  you  are  really  going 
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1  to  deal  with  any  comprehensive  issues  of  reform  today. 

2  But  the  way  it  was,  I  am  trying  to  put  it  in 

3  perspective  and  —  I  guess  the  question  that  is  really 

4  missing  is  how  does  a  situational,  comprehensive  decision 

5  maker,  which  is  a  superintendent,  principal,  and  teacher, 

6  and  they've  got  to  always  deal  with  the  forest  and  the 

7  trees  in  their  situational  decision,  and  most  of  the 

8  decisions  are  real-time  situations.    Where  does  research 

9  play  a  role?    And  the  answers  I  come  up  with  that  compare 

10  with  my  experience  with  the  lab  program  over  the  years, 

11  and  it's  really  interesting. 

12  More  and  more  it  comes  to  what  Mike  was  just 

13  saying.    Research  creeps  into  the  the  consciousness  of 

14  most  practitioners  through  opportunities  either  because  of 

15  personal  interest  to  find  out  something  you  think  may  help 

16  you  or  through  direct  experience  of  yourself  or  people 

17  like  you,  peers.    And  what  has  been  missing  most  of  the 

18  time  have  been  opportunities,  trusted  brokers,  number  one, 

19  opportunities  *o  exchange  not  only  with  peers,  but 

20  vertically  around  the  same  issue. 

21  One  of  the  things  that  we're  very  aware  of  right 

22  now  is  that  there  is  very  little  vertical  communication 

23  among  school  practitioners.    We're  spending  a  lot  of  money 

24  on  horizontal  networking. 

25  MR.  STALFORD:    Can  you  separate  vertical  and 
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1  horizontal? 

2  MR.  RHODES:    Yes,  sure,  a  quick  little  anecdote. 

3  Last  summer  we  tryed  to  unpack  the  decision  making  process 

4  of  practitioners  who  had  turned  ideas  into  action.  They 

5  said  everybody  is  trying  to  tell  us  what  to  do  in  the 

6  school.    But  nobody  knows  really  how  effective  decision 

7  makers  make  these  decisions,  and  the*  don't  either,  it 

8  seems  intuitive.    Your  Dick  Wallaces  in  Pittsburgh,  ycur 

9  effective  principals,  they  just  seem  to  get  up  there  and 
10  know  what  they  are  doing.    How  do  they  know  that? 

xl  so  we  brought  teachers,  principals  and 

12  superintendents  together  and  some  union  people  and  put 

13  them  through  a  process  to  unpack  it.    And  out  of  all  of 

14  that,  some  interesting  serendipitous  things  came  up.  On 

15  the  last  day  a  teacher  got  up  and  said,  hey  I  have  got  to 

16  tell  you,  I  never  knew  that  superintendents  had  the  same 

17  values  as  teachers.    I  never  knew  that.    And  the  union 

18  people  all  shook  their  heads,  that's  right.  The 

19  superintendent  people  said,  we  never  knew  that  unions 

20  could  be  a  positive  force  to  accomplish  what  we  want  to 

21  accomplish.    We  never  knew  that.    And  then  the  whole  group 

22  began  to  look  at  how  could  this  happen.    They  said  we're 

23  the  only  profession  where  adults  talking  to  other  adults 

24  about  the  nuts  and  bolts  of  every  day  problems  isn't  part 

25  of  doing  the  job.    We  go  to  committee  meetings,  we  go  to 
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lab  meetings.    It  isn't  part  of  doing  the  job. 

2 

Somehow  we've  got  to  get  vertical  communication. 

3 

You  see,  horizontal  isn't  enough  because  everybody  is 

4 

making  decisions  about  the  same  thing.    The  board  makes 

5 

decisions  about  policies,  superintendents  about  time,  so 

6 

does  the  superintendent,  so  does  the  principal,  so  does 

7 

the  teacher.    They  never  have  a  chance  to  see  how  they 

8 

affect  each  other,  yet  they  are  controlling  each  other. 

9 

So  we're  trying  to  build  in  vertical 

10 

communication  in  all  of  our  so  called  dissemination 

11 

processes.    So  coming  back  to  what  I'm  meaning  here  is 

12 

there  is  a  big  need  if  we're  trying  to  get  research  into 

13 

practice,  into  the  consciousness  of  minds  of  our  teachers, 

14 

principals,  and  superintendents,  there  has  got  to  be 

15 

opportunity  for  that,  there  has  got  to  be  opportunities 

16 

for  vertical  exchange,  there  has  got  to  be  opportunities 

17 

outside  of  the  vertical  exchange  for  thinking. 

18 

Situational  decision  making  doesn't  allow  time  for  thought 

19 

and  reflection. 

20 

I  am  very  much  aware  that  that  is  a  critical  role 

21 

that  the  labs  can  play  because  they're  caught  between  the 

22 

basic  researchers  who  haven't  had  the  experience  and 

23 

opportunity  to  understand  practice.    And  for  a  while,  a 

24 

lot  of  the  applied  researchers,  the  labs  didn't  really 

25 

understand  how  and  why  practitioners  would  use  research 
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1  and  other  new  information  in  their  work.    They  kept  seeing 

2  dissemination  as  a  one-way  process,  as  a  delivery  process. 

3  Yet  there  are  labs  that  understand  more  how  it  had  to  be  a 

4  two-way  interactive  process. 

5  I  think  maybe  I'll  stop  there  and  come  back  on 

6  some  of  these  other  ideas.    I  just  want  to  support  Mike's 

7  suggestion  that  we  want  to  make  the  labs  more  trusted 

8  brokers.    It  causes  a  real  problem,  as  you  say,  when  it 

9  comes  to  evaluating  facilitator,  broker  role.    Right  now, 
in  a  way,  this  office,  this  department,  this  part  of  OERI 

11  is  like  a  central  office  of  a  school  district.  It's 

12  received  as  a  blob,  in  the  words  of  your  own  former  leader 

13  bureaucrats. 

14  we're  very  aware  that  right  now  site-based 

15  management  is  falling  apart  in  most  cities  because  the 

16  central  office  isn't  being  utilized  as  facilitative 

17  brokers,  they  don't  have  the  skills.    The  superintendents 

18  don't  organize  them,  evaluate  them,  they  play  just  the 

19  role  what  you're  talking  about  the  roles  play  here.  The 

20  reason  I  say  that,  and  I  realize  it's  going  to  go  around 

21  in  a  circle,  is  that  in  order  for  the  labs  to  play  that 

22  role,  to  be  evaluated  as  a  process  facilitator,  you  need 

23  to  look  at  your  own  structure  here  and  model  it. 

I  looked  around  the  room,  there  are  at  least  a 
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25         dozen  people  here  in  this  program  who  go  back  to  the  very 
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1  beginning  of  NIE  who  represent  a  valuable  resource  in 

2  understanding  how  this  all  works,  valuable  linkage  agents 

3  to  the  associations,  to  the  field  out  there.    In  some  ways 

4  your  own  management  processes  could  be  modeling  something 

5  for  the  labs  as,  again,  informal  brokers.    There  is  no  way 

6  you  can  create,  in  reality,  the  way  the  government  has  to 

7  work,  formal  power  structures  within  OERI  for  the  labs 

8  incentives  program. 

9  But  I  don't  feel  you're  organized  right  now  in 

10  the  way  your  own  staff  has  utilized  its  resources  to 

11  facilitate  that  sort  of  brokerage  role.    What  I'm  t.-ying 

12  to  say  is  as  you  figure  out  how  to  become  facilitatv 

13  brokers,  trusted  brokers  to  the  labs,  they'll  have  a  model 

14  for  how  to  do  it  in  schools. 

15  MR.  STALFORD:     I  don't  want  to  lose  Nelson's 

16  invitation  for  other  people  to  comment  on  this  issue.  Bu1 

17  if  I  may  pursue  something  about  the  brokering  role  and  thi 

18  need  of  a  trusted  agent  in  a  situational  decision  making. 
ig  There  was  a  discussion  at  yesterday's  meeting  in 

20  part  which  focused  on  the  desirability  of  responding  to 

21  needs  as  they  occur,  to  be  there  at  the  right  time  at  the 

22  right  place.    That  is  the  words  that  were  used.    But  ther 

23  is  sort  of  a  sense  you  have  to  be  effective  in  this 

24  brokering  role. 

25  Do  you  or  any  others  have  any  organizational 
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1  thoughts  about  how  a  lab  or  anyone  that  is  organized  on  a 

2  continuing  sustained  basis  and,  indeed,  in  the  case  of 

3  labs  organized  by  regions,  how  one  organizes  oneself  to  be 

4  there  when  a  situational  thing  comes  up,  or  to  be  cabled 

5  upon  when  a  situational  thing  comes  up? 

6  MR.  RHODES:     I'll  give  you  an  example  because  it 

7  came  up  yesterday.    As  you  say,  you  only  need  help  when 

8  you  need  it.    That  is  one  of  the  problems  with  situational 

9  decision  making.    You  can't  go  to  ERIC.    You  turn  to 

10  either  a  trusted  broker  where  you  can  call  somebody  or 

11  even  if  they  don't  have  the  answer,  they  can  tell  you  who 

12  to  call  or  you've  had  some  opportunities  to  network  in 

13  such  a  way  that  you  know  who  to  call,  you  know  there  is 

14  another  superintendent  like  you  and  you've  met  him  or  her. 

15  So  the  two  access  points  come  up,  again,  out  of 

16  somebody  you  can  call  who  you  think  can  find  the  answer 

17  for  you,  or  find  somebody  who  can.    And  that  takes  a  while 

18  to  build  up  that  relationship.    You've  got  to  get  a  sense 

19  that  they  understand  what  your  problems  are  like.    But  the 

20  easy  one  to  facilitate  is  to  have  enough  opportunities 

21  where  people  get  together  with  people  who  have  similar 

22  situations,  they  know  who  to  call.    That  is  what  most  of 

23  us  vto. 

24  MR.  US DAN:    Charlie,  if  I  may,  I'll  just  kind  of 

25  piggyback  on  some  of  the  stuff  that  we're  talking  about. 
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1  I  think  part  of  it  relates  to  your  second  question  and  the 

2  anticipatory  skills  of  trying  to  try  to  sense  what  the  key 

3  educational  issues  are  going  to  be  in  terms  of  the  next 

4  funding  cycle. 

5  Lets  pick  an  example  that  I  think  kind  of  gets  to 

6  Lou's  unpacking  metaphor,  restructuring.    This  is  going  to 

7  be  an  issue.    Nobody  knows  quite  what  it  means.    The  only 

8  thing  I  think  we  all  know  is  that  school  boards  are  over 
here  on  restructuring,  the  school  superintendents  are  over 
here,  the  teachers  are  over  here,  and  it's  a  seamless  web 
because  whatever  it's  going  to  mean,  whatever  strategies 

12  get  generated,  they're  going  to  have  to  be  predicated  on 

13  everybody's  role  of  changing  in  this  enterprise. 

14  And  nobody,  to  my  knowledge,  has  begun  to 

15  systematically  pull  the  various  components  of  the 

16  ideational  government  structure  together  around  an  issue 

17  like  restructuring.    If  the  school  board's  role  changes 

18  here,  the  school  superintendent,  teachers,  et  cetera,  et 

19  cetera. 

And  if  cne  can  kind  of  anticipate  a  set  of  issues 
in  terms  of  your  request  for  proposals,  then  I  think  ore 
of  the  things  you  really  ought  to  assess  is  the  ability, 

23  the  sensing  capacity  of  the  people  that  supply  grants. 

24  Part  of  it,  I  think,  is  having  the  honest  broker  who  can 

25  tell  you  who  to  contact.    But  also,  it's  the  ability  and 
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1  with  all  respect  to  regional  disparaties,  et  cetera,  et 

2  cetera,  a  whole  set  of  salient  issues  are  going  to  be 

3  national  issues.    The  issue  of  restructuring  is  going  to 

4  surface  in  each  of  your  nine  regions  in  the  next  five  or 

5  eight  years.    And  there  are  a  whole  set,  I  think,  of 
generic  issues  that  anybody  in  this  room  could  come  up 

7  with. 

8  so  I  think  that  part  of  the  capacity  of  these 

9  labs  should  be,  instead  of  the  segmented  approaches,  that 
individual  constituencies  take  the  ability  to  coalesce,  to 

11  synthesize,  and  to  still  operate  as  the  network  pulling 

12  groups  together,  and  that  is  what  education  desperately 
needs  because  w*  're  a  fragmented  enterprise,  talk  to  each 
other,  either  horizontally,  or,  the  world  is  changing,  our 
constituency  is  shrinking,  and  the  enterprise  desperately 

16  needs  this  kind  of  capacity. 

17  i  think  labs  can  be  very,  you  know,  kind  of 
uniquely  positioned  to  kind  of  play  a  brokering  role,  not 
just  within  the  educational  world,  but  within  the  larger 
world  outside.    The  issue,  particularly  in  urban  centers 
of  linking  schools  with  other  general  governmental  human 
services  and  educational  services  in  our  areas,  is  an 
issue  that  is  going  to  be  a  explosive  one  in  the  years 

24  ahead. 

25  Maybe  for  a  change  the  labs  can  help  the 
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1  enterprise  get  ahead  of  the  action  instead  of  just  being 

2  reactive. 

3  MR.  SMITH:    Can  we  pursue  that  point  for  just  a 

4  second,  Penny?    You've  raised  a  very  critical  point 

5  earlier.    The  question  that  comes  up  that  when  you  do  have 

6  these  issues  that  absolutely  are  going  to  cut  across  the 

7  the  labs,  you  have  issues  like  restructuring  that  go 

8  across  the  whole  country  that  may  have  some  regional 

9  characteristics  but  essentially  are  the  same  issues. 

10  And  then  you  also  have  instances  come  up,  one  of 

11  which  was  mentioned  yesterday,  for  example,  teachers, 

12  there  is  a  flow  of  teachers  across  the  state  line  and  they 

13  have  to  be  sure  that  the  training  and  certification 

14  requirements  are  worked  out  on  both  and  the  lab  has  a  very 

15  specific,  regional  local  responsibility  in  a  case  like 

16  that. 

17  how  do  we  reconcile  those  two  major  objectives 

18  for  the  labs  in  the  recompetition  making  sure  that  they 

19  address,  individually  and  collectively,  these  major 

20  national  themes,  but  that  on  the  other  hand  they  give  an 

21  appropriate  sensitivity  to  indeed  have  regional  and  local 

22  characteristics? 

23  MR.  USDAN:    My  sense  is  they  have  to  do  both.  I 

24  don't  see  them  being  exclusionary.    The  issues  that  are 

25  fluent  and  the  world  they're  going  to  be  serving  is  going 
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1  to  be  constantly  fluent. 

2  MS.  EARLEY:    Two  points  picking  up  on  both  Mike's 


3 
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point  and  some  of  the  earlier  points.    I  think  we  have  to 
remember  the  important  role  of  a  broker  is  not  just  to 
throw  information  at  people,  but  sometimes  it's  to  help  us 
reflect  on  things.    A  good  broker,  if  you  are  dealing  in 
the  financial  world,  will  also  tell  you  when  it's  wise  not 
to  do  something  as  opposed  to  just  giving  you  a  cook  book 
9         for  how  you  might  go  about  doing  it. 

10  And  I  think  knowledge  brokering  is  very  similar. 

U         There  are  times  when  it  is  appropriate  to  sit  back  and 

12  reflect  on  things  rather  than  just  get  information 

13  syntheses  and  see  if  this  one  will  work  and  maybe  that  one 

14  will  work. 

I  think  that  is  an  important  role  that  brokers 

can  play,  and  that  may  involve  bringing  people  together  at 

the  right  time.    It  may  involve  being  a  little  bit  more 

forward  in  saying  here  are  some  of  the  products,  but  there 

19  are  some  others  things  that  you  need  to  think  about 

20  relative  to  that. 

And  then  picking  up  on  Mike's  point,  one  of  the 

things  that  we  do  in  my  organization  is  we  do  some  issues 

sensing  and  we  do  nationwide  tracking  of  what's  happening 

in  teacher  education  issues.    And  there  is  a  very  thin 

line  between  issue  sensing  and  agenda  setting.    And  I 


15 
16 
17 
18 


21 
22 
23 
24 
25 


9 

ERIC 


45 


10 


1  think  that  is  something  that  has  to  be  delt  with  with 

2  extraordinary  care,  while  I  think  it's  very  appropriate 

3  for  the  labs  to  do  issue  sensing.    And  I  know  some  of  them 

4  do  that  in  their  regions,  they're  trying  to  gear  up  to  do 

5  issue  sensing  kinds  of  activities. 

6  I  think  we  have  to  be  very  careful  that  in  saying 

7  that,  I'll  just  pick  up  school  restructuring,  school 

8  restructuring  will  be  an  issue,  maybe  it  will.    Are  we 

9  then  making  it  an  issue  by  the  nature  of  the  way  the 
sensing  occurs.    So  that  it's  not  that  it's  necessarily  a 

11  double-edged  sword. 

12  But  there  is  another  dimension  to  the  topic  of 

13  issue  sensing  that  becomes  almost  prescriptive,  and  I 

14  think  that  has  to  be  explored  and  a  decision  has  to  be 

15  made,  in  fact,  with  what  the  federal  government  wants  to 

16  do,  visa-vis,  the  labs;  by  doing  issue  sensing  do  you  want 

17  to  do  agenda  setting. 

18  MR.  SMITH:    A  variation  on  this  that  came  up 

19  yesterday,  when  you  have  an  issue  like  restructuring, 

20  should  we  expect  every  lab  to  try  to  develop  a  capacity  to 

21  be  expert  in  school  restructuring  or  should  they  be 

22  brokers  to  some  central  focus  of  wisdom  on  the  subject  of 

23  school  restructuring  or  some  collection  of  wisdom  through 

24  the  centers  and  labs  and  other  sources,  let's  say?  Is 
;,5  this  something  which  we  should  expect  a  capacity  to  be 
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1  built  for  in  every  region? 

2  MR.  RHODES:    You  almost  have  to,  unfortunately, 

3  because  there  is  no  center  for  wisdom  and  restructuring  in 

4  most  educational  issues  today.    The  whole  applied  research 

5  problem  today  is  how  to  learn  from  what  you're  doing,  and 

6  the  extent  to  which  the  labs  can  help  districts  learn  from 

7  what  they're  doing,  the  labs  will  gain  because  they'll  be 

8  able  to  feed  something  back  into  the  network  if,  in  fact, 

9  the  labs  are  a  network.    An  if  to  an  extent  each  lab  is 

10  independent  and  is  fighting  for  survival  and  has  no 

11  solicitator  keeping  communication  going  up  here,  it's 

12  going  be  real  hard. 

13  Let  me  throw  just  one  other  point  on  that  in. 

14  Here  is  a  place  in  the  way  you  put  out  your  solicitation 

15  it  can  have  a  lot  of  impact  on  whether  the  labs  are  going 

16  to  be  relevant  to  schools  today  because  there  are  some 

17  things  that  go  beyond  the  conventional  wisdom  in  terms  of 

18  research  and  dissemination. 

19  a  very  well-known  researcher  set  up  this  meeting 

20  last  Saturday  and  said  why  don't  we  use  all  we  know  about 

21  what  works.    And  the  point  was  made  to  the  discussion  that 

22  the  scope  of  a  problem  changes  the  nature  of  the  problem, 
and  things  that  work  in  one  classroom  or  one  building, 
very  seldom  will  work  across  the  whole  district.    Yet  a 
superintendent  has  to  make  a  decision  for  the  whole 
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1  district  because  we  seldom  do  research  or  bring  it  into  a 

2  context  where  we  say  how  could  we  make  this  work  for 

3  everybody.    Because  it  runs  against  what  the  research 

4  people  say  is  a  pure  thing. 

5  Life  isn't  pure,  and  it's  just  like  that  old 

6  fable  about  strawberry  shortcake  for  25,000  people.  You 

7  may  know  the  recipe  for  strawberry  shortcake,  but  when  you 

8  have  to  make  it  for  25,000  people,  you're  suddenly  dealing 

9  with  all  sorts  of  other  problems,  transportation,  unions 

10  all  this  kind  stuff,  and  that  is  what  you  have  to  deal 

11  with. 

12  And  we  seldom  look  at  the  research  provided  to 

13  the  decision  makers  in  a  way  that  says,  hey,  you  don't 

14  have  to  implement  it  this  way  on  the  first  day.  Here's 

15  how  you  take  this  practice  or  this  strategy  or  whatever  it 

16  is  and  start  implementing  it  so  that  you  have  equity  and 

17  excellence  in  every  decision  you  make. 

18  so  if  you  want  the  labs  to  be  facilitating,  that 

19  sort  of  mind  set,  like  it's  nice  to  know  about  how  to  come 

20  up  with  a  new  science  program,  but  if  you're  responsible 

21  for  implementing  all  the  Math  curriculum,  History 

22  curriculum,  Science  curriculum,  Geography,  how  do  you  do 

23  them  all  at  once?    If  you  want  our  labs  to  be  helping  the 

24  schools  learn  how  to  do  them  all  the  once,  which  is  what 

25  the  problem  is,  that  is  a  different  problem,  you  need  to 
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1  somehow  find  words  that  put  it  in  the  RFP. 

2  Number  two  comes  back  to  Mike's  point.    Right  now 

3  the  schools  don't  know  how  to  collaborate  with  the  other 

4  social  services,  especially  in  your  urban  areas.  Somehow, 

5  you've  got  to  get  the  labs  thinking,  and  it's  very  hard 

6  because  their  money  comes  out  of  education.    Somehow  their 

7  reward  system  through  this  program  has  to  facilitate  all 

8  the  human  services  providers  around  educational  issues, 

9  especially  in  urban  areas.    And  that  can  only  come  from 

10  the  leadership  in  this  program. 

11  MS.  HALE:    I  just  want  to  respond  to  that.  I'm 

12  not  sure  that  I  would  see  the  labs  as  they  are  currently 

13  comprised.    I  don't  think  the  labs  have  that  capacity,  and 

14  it's  not  clear  to  me  they  could  develop  the  capacity. 

15  I  think  it's  important,  as  we  think  about  the 

16  recompetition,  to  think  about  how  labs  might  get  creative 

17  about  serving  better  in  their  urban  constituents  because  I 

18  wanted  to  ask  just  for  clarification,  you  just  got  back 

19  from  an  urban  thing,  whatever  it  was.    Is  it  a  commonly 

20  held  perception,  that  you  just  stated  a  couple  of  minutes 

21  ago,  Lou,  about  the  labs  not  being  relevant  or  research 

22  not  being  relevant  on  a  day-to-day  basis,  is  that  sort  of 

23  something  commonly  held  by  the  urban  cohort  of 

24  superintendents  more  so  than  suburban  and  small  schools  or 

25  is  it  across  the  board  with  your  consituents? 
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1  MR.  RHODES:    No.     If  I  implied  that,  I  didn't 

2  mean  to.    What  you'll  find  with  your  good  urban 

3  superintendents,  and  there  have  to  be  four  or  five  good 

4  ones,  is  research  is  important  in  part  of  their  own 

5  personal  lives.    It's  crept  into  their  consciousness. 

6  They've  applied  some  of  these  things.    But  very  seldom 

7  right  out  they  don't  go  to  a  lab  and  say,  give  me  the 

8  latest  research  on  this. 

9  MS.  HALE:    My  point  is,  is  it  more  apt  that  urban 

10  superintendents  will  feel  ill  served  by  labs  in  a  way  that 

11  suburban  and  small  school  superintendents  won't  feel?  I'm 

12  trying  to  get  a  sense  of  whether  your  school 

13  superintendents  —  you  don't  know? 

14  MR.  RHODES:    1  don't  know  how  they  feel  about 

15  t^eir  own  labs. 

16  MS.  HALE:    Or  jvst  about  the  labs  in  general? 

17  MR.  RHODES:    I  was  talking  about  the  Midwest 

18  chief  yesterday  and  I  asked  him  if  he  knew  this  other 

19  chief.    He  said  not  too  well,  I  tend  only  to  talk  mostly 

20  to  chiefs  in  our  region  because  we  go  to  these  meetings 

21  sponsored  by  the  lab.    But  there  aren't  very  many  of 

22  those. 

23  MS.  HALE:    Which  may  help  answer  your  question, 

24  Nelson,  about  does  each  lab  have  to  do  a  little  bit  on 

25  this  whole  spate  of  issues  or  could  we  think  about  one  lab 
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1  developing  some  greater  expertise. 

2  I  think  the  only  way  that  would  work  is  that  you 

3  almost  have  to  have  a  lab  that  did  nothing  other  than 

4  coordinate  out  the  information. 

5  MS.  LIEB-BRILHART:    As  I'm  listening  to  the 

6  conversation  here,  I  just  want  to  point  out  that  there 

7  have  been  a  number  of  functions  mentioned  for  labs.  I 

8  just  want  to  point  out  some  of  these  are  product 

9  development  disseminations,  convening  brokering,  and  what 
I  would  call  ghost  busting,  you  know,  if  you're  in 

11  trouble,  call  us. 

12  There  are  a  lot  of  functions  here,  and  if  you  had 

13  anywhere  from  $1  million  to  $2  million  a  year  to  serve,  in 

14  some  cases,  seven  or  eight  states,  where  would  you  put 

15  your  money  if  you  were  the  feds,  on  what  strategies  for 

16  labs? 

17  MS.  STONER:    I  don't  know  if  you  can  do  it  that 

18  way,  Barb.    I've  been  interested  in  the  discussion,  and 

19  I'm  constrained  because  I  represent  the  laboratories. 

20  But  I'm  really  struck  by  the  brokering  concept. 

21  It's  an  interesting  one  and  maybe  we  ought  to  think  about 

22  that  a  little  bit.    And  I'm  also  struck  by  the  word  wisdom 

23  that  was  used  here.    And  we  might  want  to  think  about  the 

24  relationship  between  these  two  terms. 

We  get  into  a  very  simplistic  way  of  thinking, 
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particularly  when  we  think  about  research  in  this  town. 

2 

It  doesn't  just  happen  in  education,  you'll  find  it 

3 

happens  in  health,  it  happens  in  agriculture.    We  have 

4 

this  idea  that  somehow  wisdom  is  a  top  down,  flowing 

5 

mechanism,  that  it's  somehow  generated  in  an  ivory  tower 

6 

someplace.    I  came  from  the  Rural  Electric  Organization 

7 

before  I  came  to  the  Council,  so  I  can  use  this  example. 

8 

There  is  some  substation  along  the  way  where  it  is  tamped 

9 

down  like  electricity  and  then  it  flows  out  to  the  school 

10 

districts  in  some  usable  kind  of  a  way. 

11 

I  think  that  this  is  a  very  simplistic  way  of 

12 

thinking  about  wisdom,  and  maybe  we  thought  about  the 

13 

roles  of  the  labs  and  centers  25  years  ago  in  a  more 

14 

simplistic  way.    But  when  you're  thinking  about  practice 

15 

and  situational  decision  making,  the  laboratories,  from 

16 

what  I  know  about  them  over  the  years  from  working  with 

17 

them,  are  pooling  wisdom  that  is  flowing  up  from  the 

18 

actual  situations  themselves. 

19 

If  you're  in  a  distressed  school  district  in  an 

20 

urban  area,  wherever,  and  you  see  a  superintendent  and  a 

21 

group  of  teachers  that  are  coping  and  children  are 

22 

learning,  that  is  one  of  the  most  magical  things  that 

23 

happens  in  education.    And  if  the  laboratories  can  be 

24 

involved  in  that  process  and  help  translate  that  up  and 

25 

down,  it's  a  very  important  kind  of  role. 

\ 
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1  So  when  we  talk  about  brokers,  it's  not  just 

2  brokering  in  my  opinion.    I  don't  think  you  can  — 

3  particularly  when  you  use  the  dissemination  word,  it's 

4  such  a  top-down  idea.    We're  now  now  at  the  point,  I 

5  think,  where  we  need  to  think  of  the  laboratories  as  a  way 

6  station  between  a  place  to  reflect,  make  that  happen. 

7  And  also  that  means  that  they  have  another  role. 

8  When  you're  doing  brokering,  you're  really  brokering  in 

9  the  way  that  Penny  was  using  the  word  brokering,  if  you 

10  think  about  doing  deeds  in  businesses,  there  is  a  sense  of 

11  wisdom  there. 

12  So  when  there  is  reflection,  a  two-way  flow  of 

13  information  creating  a  pool  of  wisdom  that  is  different 

14  from  other  sources,  you  have  a  sense  of  risk  taking. 

15  After  reflection,  after  thought,  after  synthesis,  we  mav 

16  have  the  opportunity  to  have  people  come  with  new  courage. 

17  The  laboratories  have  an  inspirational  role  there 

18  and  a  nurturing  role  that  I  think  is  critical.    But  it's 

19  part  of  the  brokering  system,  it's  part  of  breaking  up 

20  this  idea  of  a  top-down  idea  of  wisdom,  and  it's  a  very 

21  key,  key  federal  role  of  research. 

22  Take  a  look,  let's  go  to  some  analogies.  You 

23  take  a  look  at  what  we're  doing  in  high-tech  area.  What 

24  is  the  federal  government  doing  in  order  to  disseminate, 

25  nurture  industries?    They  are  building  entities,  it's  is 
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1  just  like  we're  talking  about. 

2  OERI  has  an  opportunity  here  that  is  a  very 

3  precious  kind  of  an  opportunity.    I  also  agree  the  way 

4  you're  configured  here,  you  are  a  very  important  role 

5  model,  you  are  a  part  of  this  system.    And  it's  time  for 

6  the  Department  of  Education  to  get  out  of  this  concept  of 

7  just  shuffling  paper  and  become  a  nurturing  organization 

8  in  itself.    I  think  it's  a  v  y  important  role  for  you. 

9  MS.  HALE:    I  think  both  you  and  Lou  probably  need 
to  say  a  little  bit  more  about  sort  of  the  way  the 

11  Department  of  Education  or  OERI  or  the  teams  that  work 

12  with  the  labs  are  configured.    Do  you  see  that  one  of  the 

13  issues  is  that  they  need  to  provide  more  service  in  the 

14  same  sorts  of  ways  that  you  would  then  want  the  labs  to 

15  provide  service  to  its  constituents,  or  you're  going  to 

16  have  to  say  more?    I  don't  understand? 

17  MR,  RHODES:    I  first  got  involved  as  an  observer 

18  of  this  organization  back  when  it  was  being  created,  and  I 

19  worked  down  the  street  with  a  group  that  was  doing  a  study 

20  of  whether  there  was  a  need  for  NIE.    And  then  I  got 

21  involved  with  Milt  Goldberg  with  how  to  make  the  life  of  a 

22  project  monitor,  how  could  they  play  more  helpful  roles 

23  than  just  being  a  paper  pusher.    Over  the  years  I  began  to 

24  work  with  the  programs.    I  was  a  contractor  outside,  I 

25  worked  with  the  labs,  and  now  I  represent  the  users  so 
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1  that  I've  got  sort  of  too  much  information  as  I  said  at 

2  beginning. 

3  In  an  organization  like  this,  as  well  as  in  a 

4  school  district,  there  are  certain  decisions  that  have  to 

5  be  —  that  go  with  the  policy  of  the  board.    There  are 

6  certain  things  OERI  has  to  do  as  the  administration 

7  changes,  and  that  is  fine.    But  there  is  an  infrastructure 

8  of  people  who  represent  the  wisdom.    My  definition  of 

9  wisdom  is  i'. formation  plus  experience,  who  represent  an 

10  experience  base  who,  if  they  get  too  caught  up  with  the 

11  politics  of  it  or  the  fact  that  the  agency  always 

12  represents  a  pool  of  money  to  people  out  there  who  want 

13  the  money. 

14  They  say  there  is  a  group  in  there  who  could  be 

15  playing  a  supp^tive,  facilitative,  brokering  role.  They 

16  could  ci *  at  some  of  the  linkages  that  break  down  when 

17  people  don't  trust  you  because  you  have  got  money,  they're 

18  not  going  to  give  you  good  information  because  you  may 

19  take  away  their  grant  and  all  that. 

20  That  is  where  I'm  coming  from  in  terms  of  how 

21  this  place  needs  to  manage  its  staff  almost  apart  from  it! 

22  funding  mechanisms. 

23  Now  could  I  deviat»  a  little  bit  from  that? 

24  There  is  something  happening  in  urban  districts,  if  you 

25  look  at  where  the  good  ones  are,  that  parallels  what  is 
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1  happening  in  the  American  industry  right  now.    And  I 

2  hadn't  thought  of  it  before,  but  it  does  relate  to  the 

3  role  of  this  agency. 

4  Your  good  school  superintendents  are  in  a 

5  different  model  of  using  information  in  running  the 

6  district.    Before  they  used  to  pull  information  up  for 

7  their  decisions.    Your  good  superintendents  are  now  moving 

8  information  down  just  because  they  know  there  is  no 

9  relevant  information  without  somehow  combining  it  with 
10  experience. 

n  so  what  they're  doing  is  saying,  hey,  our  job  is 

12  information.    We  don't  know  what  to  do  anymore.  Somehow 

13  we  have  run  our  shop  in  such  a  way  that  we're  creating 

14  wisdom  by  moving  information  down,  letting  people  wade 

15  through  data  to  a  building  level,  understanding  their  own 

16  problems,  and  to  get  to  the  point  of  understanding  their 

17  problems,  now  provide  information  about  what  research 

18  says.    But  that  information  is  of  no  use  until  the  people 

19  get  to  the  point  of  having  that  need. 

20  so  the  culture  of  the  way  we're  running  schools 

21  is  changing.    We  finally  have  ended  up  with  trying  to  find 

22  a  definition  of  culture  that  would  fit  all  this,  and  we 
?3  found  one.    We  found  it  in  the  dictionary  at  the  very 

ii  bottom  of  the  page,  and  it  comes  out  of  biology.    It  says 

25  a  culture  is  a  prepared  nutrient  medium  which  allows 
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1  growth  to  take  place. 

2  And  in  fact  that  biology  model  is  exactly  right 

3  because  the  medium  is  information,    and  what  we're  trying 

4  to  do  is  help  teachers,  principals,  and  everybody  in  the 

5  district  to  havo  access  to  the  information  when  they  need 

6  it  to  allow  them  to  be  more  effective.    And  that  is  just 

7  the  role  we're  trying  to  build  in  the  central  offices  now, 

8  and  you're  talking  about  trying  to  build  it  in  the  federal 

9  government. 
How  do  you  provide  a  place  where  you  can  get 

11  access  to  information  that  is  going  to  help  you  be  aore 

12  personally  effective  in  school  —  superintendent,  to.acher, 

13  whatever  you  are.    How  does  the  lab  network,  there  is  no 

14  way  they  can  know  everything,  but  how  do  they  become  a 

15  focal  point  to  generate  information  within  their  regions 

16  which  combines  experience  and  the  best  that  we  know  from 

17  research  and  everything  else. 

18  They're  information  creators,  I  guess,  that  is 

19  their  role.    They  provide  opportunities  to  generate  widsom 

20  which  is  experience  plus  what  we  know  from  research  and 

21  then  share  it. 

22  MS.  HALE:    What  about  the  equivalent  of  a  USA 

23  Today  publication. 

MR.  RHODES:    USA  Today  is  intellectual  popcorn. 


24 


25         There  is  no  wisdom  in  it. 
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1  MS.  HALE:    1  think  I  disagree  with  you.    I  think 

2  that  is  a  model  that  would  enable  you  to  get  some  teaser 

3  pieces  of  information  out  because  people  who  want  to  know 

4  more  about  that  stuff,  then,  in  fact,  find  out. 

5  When  U.S.A.  Today  says  that  MIT  has  just  produced 

6  a  report  that  has  five  imperatives  for  regaining  the 

7  competitive  edge,  it  lists  the  five,  you  read  that,  then 

8  you  get  on  the  phone,  or  in  my  case  you  have  your  summer 

9  intern  call  MIT  and  say  how  can  we  get  a  hold  of  that 
10  report? 

1X  MR.  RHODES:    Let  me  agree  with  you  on  that. 

12  There  are  people  who  are  in  CEO  positions  for  their  unit 

3  3  who  have  to  have  what  we  call  a  snorkel  deep  understanding 

14  of  everything  because  you  don't  know  what  is  going  to  come 

15  in  the  door  next. 

16  so  you  need  a  USA  Today  just  to  know  that  if 

17  someone  else  has  got  a  -  whatever  it  is.    But  then  they 

18  also,  at  times,  or  have  access  to  know  where  to  go,  now  I 

19  really  need  to  know  what  to  do  about  this.    So  at  that 

20  point  you  really  have  to  have  the  confidence  to  have 

21  somebody  in  your  staff  or  this  trusted  broker  that  that 

22  you  can  go  to  say,  hey,  I  really  don't  know  this. 

23  MS.  STONER:    Lets  say  he  puts  on  a  tank  and  goes 

24  down  to  examine  a  problem  beyond  snorkel  deep,  he  may  come 

25  up  and  he  may  say,  you  know  that  stuff  you  told  me  doesn't 
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1  work,  it's  not  like  that  down  there.    What  the  research 

2  told  us  to  expect  isn't  actually  what  happened. 
So  there  is  an  evalutive  role  here,  as  well,  that 

4  does  come  from  wisdom  in  the  sense  of  this  experience, 

5  xliat  adds  to  research. 

6  MR.  SMITH:    We  are  scheduled  to  go  to  11:45  this 

7  morning,  and  I  think  this  might  be  a  good  time  to  take  a 

8  short  break.    Why  don't  we  just  take  a  few  minutes. 

9  (Short  break.) 
MR.  SMITH:    Before  the  break  I  said  that  I  would 

11  ask  some  of  our  other  collegues  to  comment  here,  and  I 

12  think  that  is  what  I'll  do  now,  to  ask  either  what  kind  of 

13  relationships  they  have  observed  between  their 

14  organizations  or  their  constituencies  on  the  labs  or  in 

15  case  that  is  not  available,  obviously,  what  does  their 

16  constituency  need,  what  kind  of  gaps  are  there  to  be 
filled,  what  sort  of  role  might  an  organization  like  the 

18  regional  labs  helping  their  constituents  do  their  jobs. 

19  so  let  me  first  call  on  Marily  DeWall. 

20  MS.  DEWALL:    I  was  just  saying  that  I  haven't 

21  said  anything  this  morning  because  I'm  not  very 

22  knowledgeable  on  what  the  role  of  the  laboratories 
actually  is.    I  kiow  that  NSTA,  in  the  past,  has  sort  of 
fulfilled  the  indirect  service  strategy  of  laboratories  by 
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24 


25         serving  as  a  disseminator  for  some  of  the  information  that 
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1  has  come  out  of  the  laboratories.   (Note:  NSTA  is  the 

2  National  Science  Teachers  Association.) 

3  As  a  matter  of  fact,  NSTA  has  reprinted  this 

4  document  three  times.    This  is  Research  Within  Reach, 

5  Science  Education.    It  was  actually  produced  by  the 

6  Appalachia  Educational  Regional  Center  and  apparently  the 

7  center  or  the  laboratory  only  had  enough  funds  to  print  a 

8  very  small  distribution  so  they  gave  NSTA  the  plates,  and 

9  we've  printed  them  on  a  very  large  scale,  and  we've  been 

10  selling  this  as  an  NSTA.    This  is  one  of  our  best  sellers. 

11  So  we  know  our  audience,  and  we  have  about  45,000 

12  members,  Science  teachers  who  are  teaching  preschool 

13  through  the  college  level,  are  very  interested  in 

14  research.    Most  of  our  research  is  generated  magazines, 

15  magazine  articles  and  these  come  from  primarily  the 

16  university  levels,  and  the  universities  may  or  may  not  be 

17  working  with  centers.    I  really  don't  know. 

18  I  know  in  the  late  70s  we  had  a  close  working 

19  relationship  with  the  Far  West  regional  laboratory  because 

20  their  mission  seemed  to  be  Science  and  we  were  involved 

21  with  them  in  the  production  of  their  kit  that  sort  of 

22  compared  the  alphabet  soup  program  of  the  60s.  But 

23  recently  I'm  just  not  aware  of  any  kind  of  relationship 

24  with  the  centers  or  with  the  laboratories,  and  I'm  not 

25  sure  our  members  are  really  aware  of  them. 
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1  I  said  that  I  could  talk  about  some  of  the  things 

2  that  NSTA  is  currently  concerned  with,  and  I  think 

3  probably  most  of  these  have  applications  to  work  that 

4  could  be  done  in  laboratories  and  information  that  could 

5  be  generated  from  them.    We  are,  of  course,  primarily 

6  concerned  with  the  status  of  science  education  in  the 

7  United  States.    We've  gotten  a  lot  of  bad  press  in  recent 

8  years.    We'd  like  to  help  do  something  about  it. 

9  We're  particularly  concerned  with  the  lack  of 

10  science  education  in  the  elementary  schools.    And  we  need 

11  to  have  better  preservice  and  service  programs  to  help 

12  vhese  teachers.    These  teachers  just  have  not  been  trainee 

13  to  teach  Science.    They're  afraid  to  teach  Science.  They 

14  perceive  Science  as  a  very  difficult  subject  that  they 

15  can't  do;  therefore,  Science  often  is  not  taught  at  all  ii 

16  the  elementary  schools. 

17  We're  concerned  with  teacher  qualification  and 

18  with  certification.    NSTA  has  just  started  a  certif icatioi 

19  program  where  we  offer  certification  in  nine  different 

20  Science  areas.    It  is  not  a  certification  that  replaces 

21  any  kind  of  state  certification,  it's  an  extra  credential 

22  that  a  teacher  can  get  if  a  teacher  is  pursuing  a  higher 

23  position,  it's  something  nice  to  put  on  the  resume.  But 

24  the  NSTA  certification  is  a  much  more  stringent 

25  certification  than  is  generally  given  by  the  state. 
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1  We're  also  very  interested  in  the  types  of 

2  Science  laboratory  facilities  that  are  available  and  lab 

3  equipment.    We  don't  think  from  what  we  know  that  many 

4  schools  have  very  sophisticated  lab  equipment.    This  is 

5  an  area  of  research  that  we  know  is  positive,  that 

6  hands-on  Science  is  the  way  to  go  in  the  classroom,  that 

7  doesn't  seem  to  be  born  out  in  actual  practice.  We're 

8  seeing  less  and  less  hands-on  and  less  and  less  laboratory 

9  activity  in  the  Science  classroom  and  more  of  a  reliance 

10  on  the  Science  textbook  which  obviously  is  not  going  to 

11  make  for  students  who  want  to  pursue  science. 

12  We're  interested  in  the  whole  middle  school  and 

13  junior  high  structuring.    This  obviously  is  a  grade 

14  structuring.    We  know  that  the  number  of  junior  highs  are 

15  declining.    The  numbers  of  middle  schools  are  obviously 

16  escalating.    We've  just  started  a  middle  level  publication 

17  addressed  to  middle  school  and  junior  high  Science 

18  teachers.    But  now  we're  hearing  inklings  of  information 

19  that  indicate  that  maybe  it's  not  practical  to  segregate 

20  early  adolescents  in  a  special  school  because  of  the 

21  overpowering  peer  influence  of  this  group.    Maybe  it's 

22  more  practical  to  go  back  the  K-8  configuration.    So  we'd 

23  like  to  know  more  about  that. 

24  We're  curious  about  the  possibilities  of  distance 

25  learning.    We  don't  think  this  is  terribly  practical  for 
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1  Science  teaching.    But  we  know  it's  being  done 

2  particularly  where  there  are  shortages,  for  example,  of 

3  Physics  teachers. 

4  We've  recently  been  involved  with  the  The  JASON 

5  Project  that  some  of  you  may  know  about  which  was  supposed 

6  to  motivate  kids  to  want  to  get  involved  with  Science. 

7  This  is  a  project  we  were  working  on  with  Robert  Ballard. 

8  It  was  a  two  week  down-linking  where  kids  went  to  various 

9  museums  around  the  country  and  spent  an  hour  doing  live 

10  exploration  at  the  bottom  of  the  Mediterranean  Sea  via 

11  satellite.    So  they  were  seeing  things  that  a  robot  was 

12  filming  at  the  same  time,  virtually,  that  the  scientists 

13  on  the  shipboard  were  seeing  it,  and  that  was  a  very 

14  exciting  project.    And  we're  interested  in  more  of  this 

15  kind  of  thing. 

16  I  think  our  highest  priority  right  now  at  NSTA  is 

17  the  restructuring  issue.    And  Bill  Aldridge  has  published 

18  a  paper  that  appeared  in  our  newsletter  last  January  on 

19  restructuring  the  scope  and  sequence  and  coordination  of 

20  Science  in  the  secondary  schools.    His  thesis  was  that  in 

21  many  European  schools  and  the  Soviet  Union  and  in  China, 

22  children  start  taking  Physics,  Chemistry,  Biology,  and 

23  Earth  Science  in  the  seventh  grad' ,  and  by  the  time  the/ 

24  graduate  from  high  school,  they've  had  six  years  for  each 

25  of  the  subjects.    And  this  may  be  the  reason  why  the 
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1  United  States  students  don't  compare  well  with 

2  counterparts  in  other  countries,  even  our  best  and 

3  brightest  students.    Only  20  percent  of  our  population  of 

4  students  takes  chemistry  and  physics  currently. 

5  So  this  new  plan  which  involves  teacher 

6  retraining,  new  curriculum,  obviously  we  would  have  to  win 

7  text  book  publishers  over,  just  enormous  obstacles  and 

8  possibly  a  longer  school  day,  has  a  lot  of  implications 

9  for  educating  all  students  in  all  Science. 

!0  What  we're  doing  now,  we've  just  gotten  a  grant 

11  from  the  National  Science  Foundation  for  a  major  strategy 

12  conference  which  will  be  next  month  which  involves  people 

13  from  all  levels  of  Science  education,  from  superintendents 

14  to  classroom  teachers.    And  from  this  meeting  we  hope  to 

15  identify  five  implementation  centers  around  the  country 

16  where  we  actually  try  to  put  this  restructuring  into 

17  practice  starting  with  the  seventh  grade  in  1990  and  '91. 

18  We  already  have  three  school  districts  that  want  to  do  it. 

19  Anyway  from  this  meeting  we're  hoping  that  we 

20  will  have  all  five  and  we  can  start  progressing  further. 

21  We  also  applied  for  Department  of  Education  funds  to 

22  produce  the  curriculum  materials  that  would  be  used  in 

23  this  first  year. 

24  MR.  SMITH:    Those  implementation  centers,  how  are 

25  those  going  to  be  arranged  do  you  think,  thematically? 

* 
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!  MS.  DEWALL:    I  think  one  of  the  agenda  items  for 

2  this  July  meeting  is  to  determine  that.    When  Bill  first 

3  proposed  it,  it  was  thematically.    One  center  would 
address  curriculum  and  one  center  would  address  teacher 

5  retraining.    Another  center  would  address  just  the 

6  sequence  of  classes,  the  sequencing  of  Science. 

7  so  I'm  not  sure.    Things  are  sort  of  in  flux 

8  right  now.    So  I'm  not  sure  what  the  results  of  that  will 
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MR.  SMITH:    Can  you  tell  us  where  does  the 

11  average  teacher,  principal,  curriculum  developer,  let's 

12  say,  who  is  interested  in  hands-on  Science  go  now  for 

13  assistance  in  setting  up  a  program  like  that,  putting 

14  aside  the  resource  question  for  the  moment,  but  just  in 

15  terms  terms  of  designing  a  program,  designing  a 

16  curriculum,  developing  assessment  for  it  and  those  sort  of 

17  curriculum  related  questions  that  come  up,  where  typically 

18  do  they  go  for  the  information  now. 

19  MS.  DEWALL:    Some  of  them  come  to  NSTA  or  to 

20  their  local  state  organizations.    Most  of  the  states  have 

21  a  Science  Teachers  organization.    So  there  is  a  local 

22  network  as  well  as  a  national  network.    Some  of  the 

23  schools  seem  to  be  tiod  in  with  the  university,  so  they 

24  would  go  to  the  teacher  education  people  in  the 

25  universities. 
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1  I  don't  know  how  many  of  them  are  aware  of  the 

2  exis'.-snce  of  the  laboratories.    I  would  assume  in  some 

3  areas  where  there  is  a  laboratory  near,  the  teacher  may  go 

4  there. 

5  MR.  STALFORD:    Could  you  speculate  about  thinking 

6  about  the  goals  of  NSTA  and  the  nature  of  the  laboratories 

7  as  has  been  described  here  this  morning  about  the  ways  in 

8  which  they  might  be  most  helpful,  just  from  your 

9  perspective,  might  be  most  helpful  in  achieving  your 

10  goals.    For  example,  would  it  be  helpful  if  they  had  some 

11  sort  of  science  expertise  themselves  and  were  doing 

12  research  or  applied  research  on  their  own  or  would  you 

13  look  to  them  to  be  brokers  as  the  term  has  been  used 

14  before  or  facilitators? 

15  MS.  DEW ALL:    I  think  they  could  be  helpful  to  us 

16  in  either  of  those  roles.    There  is  a  lot  of  data  that  has 

17  not  been  collected  that  would  be  very  helpful  for  us  to 

18  have.    I  think  that  the  primary,  our  primary  interest  in 

19  the  laboratories  would  just  be  to  know  about  what  is 

20  happening.    Maybe  the  laboratories  aren't  focusing  so  much 

21  on  science  and  maybe  on  a  broader  education  scale. 

22  So  we're  not  seeing  the  things  that  are 

23  specifically  related  to  your  organization.    I'm  just  not 

24  aware  of  what  the  laboratories  are  doing.    We  could 

25  certainly  help  as  far  as  disseminating  what  the 
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1  laboratories  are  doing.    I  can  see  it  as  a  two-way  avenue 

2  where  we  could  get  out  the  information  if  the  laboratories 
2  were  providing  the  things  that  would  be  helpful  to  our 

4  teachers . 

5  I  think  one  area  that  the  laboratories  could  help 

6  us  with  is  the  retraining  of  teachers  with  the  service 

7  aspect.    We  did  a  survey  of  —  NSTA  owns  the  national 

8  registry  listings  of  all  Science  teachers  in  the  country 

9  which  is  very  helpful  in  collecting  data  and  a  lot  of 
10  organizations  use  it  for  data  collection. 

X1  We  did  a  survey  in  1986  and  found  out  that  over 

12  90  percent  of  Science  teachers,  high  school  Science 

13  teachers  are  teaching  outside  of  their  subject  area  of 

14  training.    In  other  words,  Physics  teachers  are  also 

15  teaching  Chemistry  and  Math  and  Earth  Science.    And  some 

16  of  these  secondary  subjects  they're  teaching,  they've 

17  never  even  had  a  course  in. 

18  So  I  tMnk  the  the  whole  retraining  issue  is  of 

19  real  importance  to  us  and  to  be  able  to  set  up  these 

20  workshops  that  would  provide  teachers  with  current 

21  information  on  the  subjects  that  they're  teaching. 

22  MS.  LIEB-BRILHART:    We  just  recently  looked 

23  because  we  were  asked  the  question  of  what  is  happening  i 

24  Science  in  the  laboratories,  whether  they're  dealing  with 

25  it  at  all,  and  some  labs  have  a  little  bit.    But  that  is 
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1  because,  and  I  want  to  broaden  this  to  a  related  issue, 

2  that  is  because  at  a  certain  point  in  time  their  Board 

3  identified  that  as  a  need  in  the  region  for  the  lab  to  be 

4  focusing  on.    And  that  is  how  priorities  typically  get 

5  sent  by  the  laboratories  to  their  Governing  Board.  So 

6  you'll  find  different  subject  matter  entities  in  different 

7  laboratories. 

8  I  wonder  if  some  of  you  could  respond  to  that. 

9  we  have  this  tension  between  wanting  to  respond  as  a 

10  federal  program  with  national  priorities  and  then 

11  Governing  Boards  which  are  setting  regional  agendas  for 

12  the  laboratories.    Does  anybody  want  to  respond  to  the  way 

13  how  to  go  or  how  policy  might  be  derived  from  that? 

14  MS.  EARLEY:    I  think  there  is  a  wisdom  in  the 

15  terms  we  use,  regional  laboratories,  and  national  research 

16  centers,  they  suggest  that  there  has  been  thought  about 

17  this  in  the  past  and  that  the  national  issues,  there  are 

18  entities  to  deal  with  national  issues  in  a  certain  way  and 

19  that  the  regional  nature  of  the  laboratories  suggest  that 

20  that's  what  they're  to  be  about.    I  feel  that  is  a 

21  relatively  wise  way  to  go. 

22  As  I  mentioned  before,  I'm  troubled  with  too  much 

23  federal  overlay  and  too  much  direction.    We  tend  to  in 

24  over  regulating  also  create  expensive  expectations  of 

25  things  that  it's  often  very  difficult  to  meet  just  by  the 
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1  nature  of  the  expectation  that  every  priority  that  i*  set. 

2  Every  suggestion  that  becomes  a  mandate  easily  requires 

3  100  percent  of  the  time  and  resources  of  the  federal 

4  program,  whether  it's  the  labs  or  any  other  federal 

5  program. 

6  MR.      -IT!:    Adria,  do  you  want  to  talk  a  little 

7  bit  about  the  school  boards? 

8  MS.  THOMAS:     Sure  well  I'm  not  sure  how  extensive 

9  the  relationship  is  with  our  primary  concern  in  a 

10  particular  state ,  individual  things  happening  in 

11  particular  states  with  labs.    But  I  couldn't  say  how 

12  extensively  we've  worked. 

13  I* know  that  as  a  national  organization  we've 

14  worked  *ith  tne  Far  West  lab  developing  materials  for 

15  school  .  ^ard  development.    That  is  one       the  things  that 

16  we're  doing  as  an  organization.    We're  certainly 

17  expanding  —  spending  in  that  area  because  issues  are  so 

18  complicated.    Anl  with  state  intervention  and  other 

19  issues,  we're  looking  more  at  school  boards  and  getting 

20  jUwre  training  on  particular  issues  and  curriculum  things. 

21  They  don't  go  beyond  the  policy  realm  but  they  need  a 

22  little  more  information. 

23  Some  of  the  things  that  I  think  would  be  critical 

24  to  school  boards  would  be  information  on  effective 

25  practices  in  terms  of  how  to  reorganize  services  with  the 
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1  same  amount  of  moneys.    I  think  that  one  thing  is  that 

2  they  don't  read  extensive  record  reports  so  it  —  they 

3  don't  read,  don't  have  the  time  to  read  a  lot  so  it  would 

4  have  to  be  kind  of  short  pieces  of  information  to  alert 

5  them  on  things. 

6  MR.  SMITH:    You  mentioned  training  of  a  sort  that 

7  world  go  beyond  policy  related  questions.    We  discussed 

8  yesterday  the  whole  question  of  the  lab's  service  to 

9  policy  makers.    And  I  think  one  of  their  tasks,  now 

10  currently,  is  to  provide  information  on  policy  questions. 

11  Can  you  talk  about  that,  Charlie.    I'm  not  sure  if  that  is 

12  right? 

13  MR.  STALFORD:    Provide  assistance  to  state 

14  decision  makers  which  may  have  more  analysis. 

15  MS.  THOMAS:  Analysis? 

16  MR.  SMITH:    Is  that  something  the  state  board 

17  members  see  as  a  critical  continuing  kind  of  need  in 

18  addition  to  the  sort  of  thing  you're  talking  about  with 

19  training  specific  questions  related  to  practice? 

20  MS.  THOMAS:    When  you  say  at  state  level,  I'm  nor 

21  sure  exactly  what  you're  addressing.    State  associations 

22  in  terms  of  working  at  local  school  boards? 

23  MR.  SMITH:    Is  it;  limited  to  state  policy  makers 

24  or  is  it  decision  makers? 

25  MS.  LIEB-BRILHART:     It's  not  limited.    But  one 
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1  specific  task  requires  the  lab  to  work  with  the  state 

2  education  agencies  in  policy  development.    Some  of  the 

3  things  that  come  out  of  that  task  policy  analysis 

4  document,  for  example,  are  on  teacher  supply  and  demand. 

5  Several  labs  have  worked  on  that  issue. 

6  MS.  THOMAS:    Do  the  labs  work  with  the  state 

7  school  board  associations. 

8  MS.  LIEB-BRILHART:    Some  do. 

9  MR.  STALFORD:    I  stand  to  be  corrected  on  that. 

10  But  I  think  in  the  aggregate  of  that  work,  it  probably 

11  tends  to  focus  on  state  education  agencies  or  chief  state 

12  school  officers  to  a  lesser  degree. 

13  MS.  THOMAS:    That  was  my  feeling.    As  I  say,  I 

14  don't  have  an  absolute  idea. 

15  MR.  SMITH:    We  have  been  joined  by  a  new  member. 

16  Would  you  introduce  yourself,  please? 

17  MS.  WALLACE:    I'm  Sara  Wallace  ^rom  the  National 

18  Council  for  the  Social  Sciences. 

19  MR.  SMITH:    Fred,  why  don't  you  talk  a  little  bit 

20  about  your  constituency  in  the  labs? 

21  MR.  BRIGHAM:    We're  a  membership  organization  of 

22  about  8,867  elementary  and  secondfiry  schools,  215  colleges 

23  and  universities,  18,000  thousand  parish  religious 

24  education  programs.    We  would  include  in  that  adult 

25  education.    So  we  represent  rather  a  broader  constituency. 


ERIC 


71 


1  Those  groups  that  would  prime rily  relate  to  the 

2  labs  would  be  the  elementary  and  secondary  school 

3  departments  and  the  chief  administrators  and 

4  superintendent  in  the  various  dioceses,  185,  to  be  exact, 

5  across  the  country? 

6  MR.  STALFORD:     If  I  might  interject,  Fred 

7  represents  the  National  Catholic  Education  Association. 

8  MR.  BRIGHAM:     I'm,  at  this  point,  I  was 

9  mentioning  to  Nelson  at  the  break,  I'm  not  aware  of  how 

10  extensively  our  schools  use  the  services  by  the  lab  as 

11  resources.    I  do  know  that  some  of  our  schools  have  been 

12  very  active  in  working  with  the  Northeast  Regional  Lab.  I 

13  do  believe  some  schools,  business  partnerships,  and  I 

14  think  one  area  was  on  curricular  development.    I  think 

15  also  this  discussion  with  the  director  of  the  Southwest 

16  Lab,  he  indicated  that  he  was  going  to  be  contacting  some 

17  schools  down  there  on  a  special  project  to  direct  and 

18  coordinate.    But  that  wasn't  something  that  was  active, 

19  per  se,  at  this  time. 

20  In  terms  of  the  Northwest  Lab  and  how  extensively 

21  they're  relating  to  our  schools  in  an  area,  I'm  not  in  a 

22  position  to  speak  to  that.    Based  on  what  I  know  about  the 

23  Regional  Labs,  I  see  such  organization  resources  as  a 

24  valuable  center  for  all  of  education,  both  public  and 

25  private.    And  one  of  our  concerns,  goals,  is  to  effect 
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1        where  we  can  more  collaborative  models  of  public  and 

private  education  and  communities  in  a  more  effective  use 
of  community  resources.    It  seemed  to  me  that  the  lab,  if 
it  isn't  already  doing  that,  our  schools  could  utilize  the 
5         services  of  the  lab  in  that  context  more  effectively. 

He  as  an  association  would  like  to  make  known  the 
exact  services  being  offered  by  labs  and  remind  each  of 
the  constituent  members  in  those  regions  on  a  continuing 
9         basis  through  our  newsletters  and  through  other 
10  publications. 

1X  m  terms  of  the  earlier  conversation  about  what 

12  the  role  labs  might  be  or  should  be  and  brokers,  if  you 

13  will,  between  the  basic  applied  research  and  other  — 

14  introducing  schools  and  teachers  and  administrators  to 

15  resources  that  are  being  developed  and  proven  effective  - 

16  any  group  like  this  that  can  act  as  a  catalyst  or  as  a 

17  center  to  bring  people  together  can  break  down  the  walls 

18  of  isolation  that  sometimes  exist.    I  think  that  on  one 

19  hand  the  public  school  systems  have  the  isolation  that  is 

20  born  of  bureaucracy  because  I  work  in  both  the  public  and 
private  education,  private  education  depending  on  where 
it's  located.    If  it  is  in  a  suburban  or  rural  or  urban 

23  area  it  is  facing  some  of  the  problems  and  feels  very 

24  isolated.    I'm  talking  about  the  principals,  especially. 

25  so  whatever  can  be  done  to  bring  a  sense  of 


21 
22 


ERIC 


73 


1  community,  to  establish  a  sense  of  community  among  all  of 

2  us  who  share  the  same  educational  goals,  more  effective 

3  education  for  students,  I  see  it  as  an  opporutnity. 

4  The  other  question  I  raise  here,  and  again,  it 

5  can  be  clarified,  someone  may  be  able  to  tell  me,  to  what 

6  extent  the  labs  use  technology  in  disseminating  their 

7  information  and  also  obtaining  information  from  the  people 

8  they  serve. 

9  I  have  found  on  an  experiment  that  we're  working 

10  on,  pilot  project,  a  conferencing  network  that  there  is  a 

11  craving  on  the  part  of  people  in  different  parts  the 

12  country.    I'm  talking  about  administrators  to  share  and  I 

13  have  schools  in  Canada,  New  Jersey,  Oklahoma,  California, 

14  Ohio  different  in  both  students  and  teachers  and 

15  especially  administrators.    I've  been  impressed  by  the 

16  wealth  of  knowledge  that  is  out  there  and  also  the  craving 

17  for  knowledge  and  the  willingness  to  us  a  computer  to 

18  develop  projects. 

19  i  know  that  individual  schools  are  doing  that  and 

20  we're  talking  now  with  people  how  we  might  expand  that.  I 

21  think  one  of  the  problems  that  needs  to  be  faced  by  these 

22  labs  is,  or  could  help,  is  a  whole  question  of  integration 

23  of  technology  in  the  education  process.    It's  been  brought 

24  into  our  schools  as  a  learning  tool.    It's  been  used  and 

25  is  being  used  as  an  administrative  resource  for 
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1  administrators  as  an  information  resource.    I  think  the 

2  most  important  fruit  of  that  in  terms  of  this  knowledge 

3  explosion  we're  dealing  with  is  the  ability  to  bring 

4  people  together  as  learning  communities  and  more  is  needed 

5  in  the  equipment.    There  is  a  need  for  people  who  are 

6  conversant  with  the  way  this  works  to  be  serving  school 

7  districts,  individual  schools,  both  public  and  private. 

8  That  is  my  thought  there.    I  see  these  lab 

9  centers  as  being  able  to  effect  that  based  on  what  I  know 
10  about. 

n  jjp.  SMITH:    You  raised  a  question  which  I  think 

12  goes  back  to  Dena's  comment  earlier,  and  I'd  like  to  go 

13  back  to  you,  Dena.    You  said  before  that  we  sometimes  have 

14  had  the  image  that  dissemination,  is  something  that 

15  occurred  sending  wisdom  on  down  to  the  local  level  and 

16  that  you  favor  a  more  collegial  sharing  kind  of  approach 

17  where  wisdom  also  babbles  up  from  the  local  level. 

18  m  a  technological  age,  we  now  have  the  ability 

19  to  draw  from  more  of  the  world  instantaneously  to  put 

20  together  wisdom,  if  you  will,  and  have  it  bubble  up  or 

21  down  in  any  way  the  center  and  the  receiver  decides.  Can 

22  you  comment  on  what  kind  of  implications  that  might  have 

23  for  the  question  of  regional  service? 

24  m  other  words,  if  a  lab  is  operating  in  a  given 

25  region  of  the  country  and  yet  it  can  draw  from  all  around 
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1  the  country  and  all  around  the  world  and  then  disseminate 

2  around  the  country,  do  you  think  that  has  implications  for 

3  the  nature  of  the  regional  services  that  the  labs  deliver? 

4  MS.  ST0N2R:    I'll  have  to  move  to  the  assumption 

5  question  first.    The  vay  I  was  using  the  concept  of  wisdom 

6  was  not  something  necessarily  that  can  be  captured  or 

7  filed,  necessarily.    But  it  is  a  collaborative  role  that 

8  is  not  necessarily  technological. 

9  You  can  use  technology  to  do  the  other  kinds  of 

10  things  that  laboratories  do  which  are  those  that  Mr. 

11  Brigham  noted:  in-servicing  roles,  their  own  development, 

12  their  own  research  activity  that  they  do  in  collaboration 

13  usually  with  practitioners  and  other  researchers  and 

14  universities. 

15  so  I  think  we  need  to  make  sure  that  we're  using 

16  the  word  wisdom  in  more  than  just  a  data  informational 

17  sense.     I  was  using  it  in  a  much  broader  sense,  and  I 

18  think  you  were  too. 

19  MR.  RHODES:    The  word  wisdom  isn't  the  problem, 

20  the  word  is  technology.    I  don't  think  we  want  to  use 

21  technology.    What  we're  trying  to  say  is  what  could 

22  technology  allow  the  labs  to  do. 

23  MS.  STONER:    How  does  it  inform. 

24  MR.  RHODES:    No,  technology  doesn't  inform.  What 

25  we're  talking  about  are  isolated  practitioners.    There  is 
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1  one  teacher  to  a  class,  one  principal  for  a  building,  one 

2  superintendent  for  a  district.    Who  do  they  need  to  be 

3  connected  to  and  how  how  often  when  they  want  to  do  it. 

4  What  technologies  do  we  have  today  that  would 

5  allow  people  the  access,  the  information  they  need  when 

6  they  need  it  that  will  allow  them  pure  networking,  trust 

7  and  support.    And  we  have  the  technology  and  most  of  them 

8  are  being  misused  because  they're  being  applied  the  old 

9  delivery  mechanism  way. 

10  m  the  way  you're  talking  about,  the  ideal  thing 

11  would  be  for  every  teacher  and  administrator  to  have  a 

12  computer  in  their  home.    The  only  time  you  have  a  chance 

13  to  reflect,  to  think  in  any  reactive  job  is  when  you're 

14  showering,  going  to  bed  at  night,  or  driving  to  work. 

15  There  is  no  school  board  in  the  world  that  would 

16  give  teachers  and  administrators  a  computer,  one.  And 

17  two,  take  them  home.    Most  of  the  people  who  are  operating 

18  electronic  conferencing  are  trying  to  do  bulletin  boards 

19  which  is  a  poor  concept  because  nobody  even  uses  cork 

20  bulletin  boards.    Once  you've  seen  what's  on  the  bulletin 

21  board  you  stop  looking.    That  is  what  has  happened  with 

22  electronic  bulletin  boards. 

23  what  is  working  now  because  what  you're  taking 

24  about  are  facilitated  conferences  where  there  is  a  broker 

25  or  facilitator  who  keeps  the  thing  moving.    And  again, 
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1  every  lab  you've  got  right  now  that  are  trying  it  and 

2  experimenting  with  it  are  doing  very  well. 

3  But  that  ought  to  be  one  of  the  mandated 

4  functions.    The  things  we're  talking  about  can  be  done  a 

5  lot  better  electronically.    Once  people  start  modeling  and 

6  putting  it  out  there  and  schools  start  discovering  and 

7  they  can  find  these  things  out  from  their  peers  when  they 

8  need  it. 

9  So  in  terms  of  what  you're  saying,  yes, 

10  technology,  that  type  of  technology,  interactive,  pure 

11  exchange,  comparative  conferencing,  audio  conferencing,  it 

12  is  a  means  to  allow  people  to  do  more. 

13  mr.  SMITH:    You  think  that  it  does  or  ought  to 

14  modify  their  brokering  rule  for  everyone  of  the  labs, 

15  whatever  their  specific  area  is? 

16  MR.  RHODES:    I  have  a  weird  point  of  view.  I 

17  feel  the  federal  government,  in  its  guidelines,  blows  the 

18  lawyers  minds  that  there  are  some  programs  in  the  old 
Office  of  Education  that  did  this  who  put  out  in  their 
guidelines  and  that  are  to  be  processed,  processed.  So 

21  that  the  people,  you  know,  the  mandate  how  people  plan, 

22  who  they  have,  how  they  collect  information  and  learn  from 
it  and  how  they  share  it  with  is  the  way  you  design  your 
reporting  systems.    They  have  to  have  this  in  order  to  get 
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1  And  the  types  of  things  that  you're  talking  about 

2  here  are  process  activities  like  problem  focused  meetings 

3  from  repair  exchange  and  commercial  exchange  so  that 

4  electronic  conferencing  can  be  put  in  the  guidelines,  how 

5  they  feedback  their  learnings,  "developing  wisdom"  to  the 

6  somebody  in  the  OERI  who  can  share  that  with  others. 

7  Right  now  most  of  the  the  time  they  feedback  just 

8  accounting  stuff  where  you  have  to  be  careful  you  don't 

9  get,  you  don't  do  something  wrong. 

10  i  would  think  you  can  mandate  that  they  network 

11  access  points.    If  we  know  that  an  isolated  practitioner, 

12  they're  first  going  to  turn  to  somebody  they  trust,  either 

13  in  their  university  or  their  intermediate  agency  or  their 

14  peers.    How  can  the  labs  network  those  people  they're 

15  going  to  turn  to? 

16  we  should  be  networking  those  intermediate  access 

17  points  somehow  the  labs  function.    I  guess  that  is  the 

18  type  of  thing  I  would  like  to  see  in  an  RFP,  something 

19  that  goes  all  into  the  same  process  and  almost  forces, 

20  shapes  the  way  people  continually  learn. 

21  MS.  STONER:    Mr.  Smith,  I  don't  see  the 

22  inconsistency.    You  c_n  use  technology  and  have  networking 

23  processes  and  have  regional.    They  are  absolutely  not 

24  incompatible.    And  when  you're  dealing  with  technology, 

25  and  it's  a  problem  right  nov,  when  you're  dealing  with 
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1  policy  makers  on  the,  particularly  when  you  think  about 

2  isolated  schools,  they  think  technology  is  the  answer,  and 

3  it's  not. 

4  I  mean  we  must  be  concerned  about  the  substance 

5  that  the  technology  uses  and  it  must  be  used  within  a 

6  role.    Technology  is  also  not  the  role  of  the  laboratory. 

7  It  is  a  tool,  a  means  for  expressing  the  role  of  the 

8  laboratory  which  is  multifaceted  given  the  demands  of  a 

9  region.    There  are  all  kinds  of  things  that  it  needs  to 
10  do. 

H  MS.  EARLEY:    Perhaps  you  can  clarify  something 

12  for  me.    I  think  I've  1.  \rd  in  a  couple  of  questions  today 

13  a  kind  of  subtheme  that  has  not  really  been  addressed,  and 

14  maybe  it  just  needs  to  sort  of  crawl  out  on  to  the  table 

15  here.    And  that  is  the  integrity  of  the  existing  regions. 

16  I  think  perhaps  there  have  been  some  questions  that  have 

17  been  posed  to  us  whether  or  not  regions  are  necessary, 

18  whether  or  not  efficacy  is  a  regional  configuration?  I'm 

19  just  curious  as  to  whether  or  not  with  this  is  one  issue 

20  that  OERI  is  going  to  address? 

21  MR.  SMITH:    I  think  it's  about  what  has  been 

22  raised  and  everything  is  on  the  table,  all  the  questions 

23  that  pertain  to  the  operation  and  structure  of  the  labs 

24  are  open  to  discussion  at  this  point.    And  that  is  the 

25  reason  why  we're  having  this  meeting  and  the  meeting  in 
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1  July  as  well.    Do  you  have  a  doubt  about  that,  a  common 

2  doubt  that  the  regional  question  is  it,  it  is,  or  as  it 

3  might  be? 

4  MS.  EARLEY:     I  suppose  I  do.     In  listening  to 

5  some  of  the  discussions,  and  this  is  sort  of  in  passing, 

6  technology  doesn't  necessarily  complicate  an  issue. 

7  So  the  question  is,  if  you  do  have  a  kind  of 

8  technology,  is  there  a  necessity  for  having  regions?  And 

9  I  would  tend  to  say,  yes.    And  I  would  tend  to  think  that 

10  the  regions  serve  a  different  kind  of  function  that  is 

11  separate  from  whether  or  not  they  interact  with  each  other 

12  or  go  across  regional  lines  to  do  some  of  the  work  that 

13  they  do.    And  it's  creating  something  that  is  a  manageable 

14  unit  and  creating  a  network  or  a  community  of  states  in  an 

15  area  that  surely  can  make  an  argument. 

16  Maybe  you  can  divide  up  the  United  States  in  lots 

17  of  different  ways.    But  the  states'  idea  of  a  community 

18  has  been  created  much  that  their  community  is  created 

19  around  a  lab  and  people  feel  comfortable  in  working  one  or 

20  the  other.    So  before  0ERI  would  consider  redesigning  its 

21  way  the  regions  are  configured,  I  would  hope  that  they 

22  would  give  some  very  serious  consideration  to  the 

23  importance  of  communities  that  have  been  developed  in  the 

24  those  regions  and  what  would  be  the  consequences  to  those 

25  communities  of  educational  organizations  if  there  were  a 
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1  reconfiguration? 

2  MR.  SMITH:    I  think  the  way  the  question  arose 

3  yesterday  night  inform  this  discussion  a  little  bit  more. 

4  It  came  up  yesterday  as  a  question  of  the 

5  relationship  to  states  among  other  things,  but  principally 

6  what  the  interests  of  the  states  are,  are  they 

7  sufficiently  served  by  the  representation  the  states  have 

8  on  the  governing  boards,  is  the  arrangement  of  a  state  as 

9  a  whole  representing  an  interested  state,  and  can  the 
constituencies  within  the  states  be  met?    In  a  way,  I 

11  think  that  is  a  subquestion,  and  one  that  you  just  brought 

12  up,  and  we  also  invite  discussion  to  that  as  well. 

13  mr.  USDAN:    For  administrative  and  substantive 

14  reasons,  you  have  to  decentralize.    At  the  risk  of  perhpas 

15  alienating  some  friends  at  the  state  level,  I  think  that  a 

16  few  years  ago  the  educational  reform  movement  was 

17  predicated  on  state  dominance. 

18  now,  however,  I  really  feel  that  one  of  the  very 

19  major  issues  is  how  state  and  local  relationships  are 
going  to  be  redefined  in  the  1990 's.    We  have  had  so  many 
reform  waves  that  I  am  drowning  in  them.    I  think  that 
there  has  been  a  consensus  recently  evolving  around  the 
country  that  indeed  if  anything  meaningful  and  enduring  is 

24  going  to  happen,  it  is  going  to  happen  at  the  building  and 

25  district  level. 
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1  I  would  argue  that  one  of  the  most  important 

2  networking,  brokering,  and  convening  roles  of  the  labs  in 

3  the  1990 's  will  be  to  serve  as  a  mediating  force  that  can 

4  transcend  the  particular  vested  interests  of  state  and 

5  local  officials,  associations  and  groups.    I  think  there 

6  is  going  to  be  an  urgent  need  for  a  great  deal  of  very 

7  sustained  local  and  state  dialogue  and  that  the  labs  can 

8  play  a  crucial  role  in  brokering  the  process. 

9  In  other  words,  those  concerned  with  influencing 

10  educational  policy  will  have  to  pay  as  much  attention  to 

11  local  groups  as  they  have  to  state  groups  in  the  '80s.  I 

12  would  argue  that  the  country  in  terms  of  educational 

13  reform  is  at  a  different  place  in  1989  than  it  was  in  '85 

14  in  terms  of  the  respective  roles  which  both  local  and 

15  state  authorities  must  play  in  the  future. 

16  Although  education,  of  course,  remains  a  legal 

17  responsibility  of  the  states,  local  perspectives  will  ha/e 

18  to  be  brought  into  the  forefront  of  the  education  reform 

19  debate  to  a  greater  extent  than  they  have.    This  will  be 

20  so  even  if  the  local  level  isn't  easily  defined  because  it 

21  consists  of  more  than  just  -he  district;  increasingly 

22  local  is  going  to  be  defined  -C  the  building  level.  New 

23  building  level  initiatives  are  starting  in  Chicago,  Dade 

24  County,  Rochester  and  growing  numbers  of  other  places. 

25  Indeed,  the  very  nature  and  structure  of  collective 
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1  bargaining  will  be  reassessed  in  growing  numbers  of 

2  districts.    I  think  there  are  growing  grass  roots  efforts 

3  emerging  throughout  the  country  to  change  governance 

4  patterns  that  will  require  much  more  intensified 

5  local-state  dialogue.    The  labs  in  the  1990 's  ought  to  be 
C  positioned  to  facilitate  and  influence  this  discussion. 

7  MR.  SMITH:    That  means  your  governing  bodies  that 

8  you  pay  as  much  attention  to  some  of  local  groups  as  you 

9  have  the  state  groups  in  the  '90s.    Because  T  think  —  mid 

10  '80s  because  I  would  argue  that  I  think  the  country  in 

11  terms  of  educational  reform  is  at  a  different  pxace  in 

12  1989  and  1990  than  it  was  in  '85  in  terms  of  respective 

13  roles,  the  local  and  state  issue. 

14  MR.  US DAN:     I'm  not  sure.     I'm  not  that  aware  of 

15  your  government  structure.    I  know,  for  example,  that  the 

16  chiefs  play  a  particularly  critical  role  in  the  current 

17  configuration  and  obviously  their  public  education  remains 

18  a  legal  responsibility  of  states. 

19  i  just  feel  that  chiefs,  by  definition,  and  I'm  a 

20  former  state  bureaucrat,  too.    I  know  the  prerogatives,  I 

21  know  the  turf.    Bvt  somehow  or  other  I  think  you've  got  to 

22  ensure  that  local  perspectives  are  built  into  the  table  as 

23  well.    And  even  local  isn't  easily  defined  because  it's 

24  more  tr  ".n  the  district  level,  increasingly  it's  going  to 

25  be  t»»cs  building  level.    It's  starting  in  Chicago,  starting 
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1  in  other  places.    It's  started  in  Dade  County  and  it's 

2  starting  in  Rochester  and  these  other  places.    It's  the 

3  reconfiguration  of  collective  bargaining. 

4  In  many  parts  of  the  country  that  is  beginning  to 

5  happen.    I  think  there  is  a  kind  of  a  grass  roots  kind  of 

6  movement  in  terms  of  the  government  issues  that  I'm  not 

7  sure,  what  triggered  it  in  my  mind  was  that  the  concern 

8  that  the  state  is  being  represented. 

9  MR.  SMITH:    What  about  other  regional 

10  associations  such  as,  for  example,  the  Southern  Growth 

11  Policies  Board,  something  like  that  where  there  is  a 

12  regional  preformed  body  that  has  interest  and  include 

13  education  in  those  areas,  would  those  be  inappropriate? 

14  MR.  USDAK:    I  think  the  linkages  certainly  should 

15  be  made  with  those  groups  and  the  labs  located  in  those 

16  areas.    I  don't  know  whether  they  have  tied  into  those 

17  groups  or  not.    But  if  I  had  the  power  of  life  and  death 

18  over  proposals,  I  would  mafce  sure  that  the  thinking 

19  included  that  kind  of  perspective  to  break  people  in 

20  traditional  educational  institutions  out  of  their  own 

21  parochial  and  narrow  turf.    I  think  it  should  be  a 

22  prerequisite. 

23  What  the  public  schools  have  going  for  them  in 

24  the  future  politically  is  the  linkage  with  economic 

25  development  because  we  don't  have  the  troops  any  longer. 
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1  You  don't  have  the  numbers,  there  are  only  23  percent  of 

2  adults  in  the  country  with  kids  in  schools. 

3  So  our  hope  is  the  linkage  with  the  economic 

4  development  argument,  most  notably  in  the  South  where  so 

5  much  of  the  action  has  taken  place,  and  with  the  influence 

6  and  the  role  of  the  business  community  which  is  linked 

7  witn  the  political  community  in  terms  of  economic 

8  development.    That  is  why  they're  interested  in  the  issue, 

9  not  because  of  esoteric  issues  and  pedagogy  or  educational 

10  research. 

11  MR.  SMITH:    We  have  two  disciplinary  groups  at 

12  the  table  and  Marily  was  saying  she  was  wondering  if  you 

13  were  the  only  we  have  invited  along  with  the  Reading 

14  Associations  that  were  here  yesterday. 

15  Ms.  Wallace,  would  you  like  to  talk  about  Social 

16  Studies  and  they're  relationship  with  the  labs? 

17  MS.  WALLACE:    I'm  not  sure  that  we  have  a  direct 

18  link  with  the  labs.    I  think  that  we  are  interested  and 

19  try  to  be  informed  about  what  the  the  labs  are  doing.  I 

20  have  a  little  bit  more  experience,  personally,  with  the 

21  Far  West  Lab  than  I  do  with  any  other  labs  that  we  talked 

22  a  little  bit  about,  the  relationships  between  Far  West  Lab 

23  or  school  districts  or,  in  particular,  those  districts  in 

24  California  in  which  I  was  involved. 

25  I  can  share  with  you  some  of  the  things  that 

ERJC  V4.i 


86 


1  we're  doing  at  NCSS  and  how  we  operate  and  n.aybe  dispel 

2  some  misconception  about  what  Social  Studies  is  for  us. 

3  We  see  the  term  Social  Studies  as  an  umbrella  term 

4  that  embraces  the  specific  subject  areas,  History, 

5  Geography,  Economics,  Anthropology,  Social  Psychology, 

6  Sociology,  Political  Science.    And  in  those  areas,  we  as  a 

7  national  council,  represent  26,000  members  who  are  also 

8  members  of  110  affiliates  throughout  the  United  States. 

9  we  represent  members  in  69  countries;  although  we  are  not 

10  considered  an  international  organization.    We  do  have 

11  memberships  in  these  various  countries  and  certainly  from 

12  time  to  time  are  doing  research  on  subjects  of  interest  to 

13  our  members,  whatever  they  are. 

14  We  also  have  within  the  organization  affiliated 

15  with  the  National  Council,  a  College  and  University 

16  Professors  Group  that  we  look  to  present  research  and 

17  answers  to  some  questions  and  curricular  design  along  with 

18  a  supervisors'  affiliate.    And  the  supervisors'  affiliate 

19  represents  a  state  and  local  Social  Studies  curriculum 

20  throughout  the  United  States. 

21  So  we  look  to  those  two  groups  along  with 

22  national  staff  to  tell  us  what  is  needed  out  in  the  field, 

23  to  talk  about  curriculum  design,  to  assist  local  groups 

24  and  teachers,  whether  they  be  at  the  county,  regional,  or 

25  state  level,  and  design  a  curriculum  to  fit  local  needs. 
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1  We  do  not  design  curriculum  because  we  don't  believe  in  a 

2  national  curriculum.    We  believe  that  is  left  to  the  state 

3  and  local  groups. 

4  The  association  has  adopted,  and  that  will  be 

5  printed  and  published  in  the  fall,  three  model  scopes  of 

6  sequences  that  we  are  recommending  and  this  grew  out  of 

7  about  a  five-year  study  of  vhat  we  think  is  needed  and 

8  what  our  members  tell  us  is  needed  out  there.    I  don't 

9  know  how  the  regional  labs  will  fit  into  this  other  than 
^0         at  some  point  I'm  sure  as  these  scopes  and  sequences  are 

11  designed,  for  instance,  on  papers  as  curriculum  designs, 

12  there  wii?  be  some  need  for  objective  evaluation  of  how 

13  that  fits  with  what  we  think  students  ought  to  know. 

We  are  as  concerned  about  content  and  when 

students  begin  to  look  at  content  as  we  are  about  the  need 
for  students  to  be  able  to  think  critically  about  what 

17  they  are  presented  in  Social  Studies.    We  sometimes  get 

18  criticized  for  being  more  process  oriented  than  we  are 

19  content  oriented.    I  assure  you  that  is  not  the  case. 

20  It  is,  however,  a  case  that  we  are  a  very  diverse 

21  group  and  very  few  people  can  decide  on  exactly  what  the 

22  facts  are.    So  we  think  that  students  need  to  be  presented 

23  with  a  number  of  facts  and  they  n«:ed  to  be  able  to 
criticize  those  facts.    And  critical  thinking  is  what  I'm 
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1  and  to  the  degree  that  regional  labs  can  design,  can 

2  design  objective  evaluation  processes  so  that  we  know  that 

3  that  is  happening,  that  is  something  we'd  be  very 

4  interested  in  looking  at. 

5  And  I  would  concur  with  Mr.  Briyham  that  we're 

6  concerned  about  technology  isolation  by  teachers.    We  know 

7  that  teachers  go  into  a  classroom,  close  doors  and  they're 

8  very  isolated.    And  what  they  don't  know,  no  one  else 

9  knows  that  they  don't  know. 
So  I  think  that  if  teachers  had  some  way,  some 

11  nonthreatening  way  of  being  able  to  communicate  with  other 

12  professionals  and  talk  about  some  of  the  concerns  that 

13  they  have,  some  of  the  problems  that  they  have  in  dealing 

14  with  the  students  as  well  as  the  content  and  locating  the 

15  content,  just  in  sharing  the  stresses  that  they  feel  about 

16  the  job. 

17  so  we'd  like  to  see  technology  used  in  a  way  that 
is,  perhaps,  not  traditional.    We're  not  talking  about  the 
teacher  being  able  to  go  in  and  sit  at  a  word  processor 
and  come  up  with  lesson  plans  for  the  day,  and  that  is  all 

21  we're  talking  about.    It's  a  lot  more  than  that. 

22  We're  interested  in  and  concerned  about  teacher 

23  certification  and  we're  members  of  a  group  that  is 

24  designing  and  making  some  statements  about  teacher 

25  certification  and,  of  course,  we've  been  intimately 
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1  involved  with  the  Commission  for  the  Study  of  Social 

2  Studies  which  we're  hoping  will  propose  their  finding  in 

3  November.    And  I  think  that  is  the  time  that  they've 

4  designated  is  when  at  least  preliminarily  the  report  will 

5  be  out. 

6  We're  also  concerned  about  teaching  standards  or 

7  college  programs  dealing  with  the  certification,  the 

8  initial  certification,  analyzing,  testing  of  teachers.  We 

9  see  too  many  Social  Studies  teachers  as  Science  teachers. 

10  Too  many  teachers  take  on  the  roles  that  they  are  not 

11  prepared  to  teach.    Many  of  our  Social  Studies  teachers 

12  are  teaching  part  time  because  they've  had  to  take  a  year 

13  of  American  History  and  Government  and  many  of  them  would 

14  prefer  to  be  doing  something  else.    But  because  they  have 

15  a  certain  number  of  subjects  in  the  Social  Studies  area, 

16  either  History  et  cetera,  or  one  of  the  other  subjects, 

17  they  are  trapped  to  teach  Social  Studies.    Often  some  of 

18  them  are  waiting  to  be  coaches.    Some  of  them  are  coaching 

19  and  that  is  their  primary  reason  for  being  there  and 

20  waiting  until  there  is  opportunity  to  move  out  of  this 

21  peripheral  subject  area  for  themselves.    And  we're  very 

22  concerned  about  that. 

23  We'd  like  to  see  teachers  trained  to  teach  at 

24  that  area  and  that  they're  compatible  in,  and  I  don't  know 

25  how  the  regional  laboratory  can  fit  into  that.    I  do  know 
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1  it's  a  problem.    I  do  know  that  the  members  share  witn  us 

2  that  they  are  concerned  ibout  being  strapped  to  subjects 

3  that  they  are  not  prepared  to  teach,  that  they  have  not 

4  had  any  real  dealings  with  since  they  were  in  their 

5  freshmen  and  sophomore  years  of  college. 

6  And  yet  we  look  at  declining  enrollment  in  some 

7  districts  and  collective  bargaining  and  because  they  have 

8  it  on  their  credentials,  they  are  certainly  tied  to  accept 

9  that  certain  subject  they  are  placed  into  at  that  role. 

10  Maybe  I  can  stop  there  and  have  you  ask  me  some 

11  questions.    One  other  thing  that  we  would  like  to  see 

12  Social  Studies  become  is  more  a  part  of  the  elementary 

13  curriculum.    We  know  that  Reading  is  important,  Math  is 

14  important.    We  think  that  Social  Studies,  as  does  Science, 

15  and  I  say  that  not  because  Marily  is  there  because  that  is 

16  what  I've  seen  having  come  just  15  months  from  a  school 

17  district  and  seeing  that  it's  very  easy  to  put  Social 

18  Studies  aside  and  not  teach  Social  Studies  at  the 

19  elementary  level. 

20  We  think  that  students  can  learn  many  things  much 

21  earlier  than  they  are  now  being  given  credit  for  learning. 

22  MR.  SMITH:    One  question  I'd  like  to  ask  Barbara 

23  about.    To  what  extent  do  labs  now  participate  in 

24  evaluation? 

25  MS.  LIEB-BRILHART:    There  is  some  of  it 
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1  particularly  in  the  area  where  they're  doing  applied 

2  research  which  is  part  of  the  scope  of  work  where  they 

3  might  look  at  a  program  and  test  the  effects  be 'ore 

4  disseminating  it  more  broadly  in  the  region.    There  is 

5  some,  it's  not  a  large  part. 

6  MR.  STALFORD:    They  do  some  other  contracts  on 

7  the  side,  it  varies  by  lab  to  lab? 
MS.  LIEB-BRILHART:    There  is  a  wide  variation. 
MR.  SMITH:    We  have  to  wrap  up  in  a  very  few 

minutes  here.    It's  just  about  11:45  now.    Does  anybody 

11  have  a  final  comment? 

12  MS.  STONER:    One  of  the  things  that  we  haven't 

13  raised  so  far  and  I  think  we  need  to  get  it  on  the  table 

14  is  discussions  about  policy  makers  and  the  role 

15  laboratories  play  in  working  with  and  for  policy  makers. 

I  think  we  need  to  recognize  something  that  is  a 

characteristic  of  policy  makers  who  are  in  action.  They 
can't  wait  until  the  research  study  about  how  to  teach 
Social  Studies  is  out  15  months  from  now.    They  must  move 
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Laboratories  do  have  knowledge,  and  when  asked, 
they  provide  opinions  and  give  to  the  extent  that  they  can 
acknowledge  that  they  have  it.    They  are  risk  takers  in  a 
sense  and  they  give  it  to  a  whole  group  of  policy  makers. 


25         And  I'd  just  like  to  name  some  more  names,  teachers, 
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1  school  boards,  chief  state  school  officers,  state 

2  legislators.    I  won't  get  them  all. 

3  But  one  we  haven't  talked  about  at  all  here  and 

4  that  is  the  U.S.  Congress.    They  look  to  the  laboratories 

5  also  for  opinions  and  fcr  knowledge  about  what  is 

6  happening  in  action  because  they  are  also  always  in  action 

7  and  having  to  take  risks. 

8  So  they  play  a  very  critical  role  with  policy 

9  makers  in  the  classroom  or  whatever  it's  trying  to  decide 

10  what  to  do.    And  then  when  a  decision  is  made,  as  my 

11  collegue  said  so  well  here,  that  once  a  decision  is  made, 

12  it  immediately  changes  the  nature  of  the  problem  and  so 

13  what  the  same  decision  that  was  given  before  may  not  work 

14  the  next  time.    So  they're  in  a  fluid  situation.    And  I 

15  think  we  need  to  remember  that. 

16  MS.  LIEB-£iRTLHART:    One  thing  to  add  is  that 

17  they're  increasingly  doing  policies  and  option  papers  for 

18  state  legislatures  as  I  look  through  the  list  of  products 

19  here. 

20  MR.  RHODES:    One  final  word,  I  guess,  about  the 

21  nature  of  where  you  go  from  here  and  your  chances  of 

22  producing  something  on  paper  for  a  program  that  will 

23  survive  a  political  environment  and  reality,  how  important 

24  is  your  own  understanding  of  conditions  for  which  the  labs 

25  are  there?    Even  though  you  can't  always  get  the  lawyers 
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1  to  do  the  right  words,  it's  important  that  we  all 

2  up  erstand  what  the  important  function  that  we've  all  been 

3  trying  to  find  words  for,  and  I'm  going  to  have  to  go  back 

4  to  the  biology  metaphor  because  when  you're  in  an 

5  association,  you  get  invited  in  all  the  curriculum  groups. 

6  They're  all  redesigning  a  curriculum. 

7  And  the  only  thing  I  can  come  up  with  is  two 

8  words  and  they  don't  connect.    The  research  curriculum 

9  designer,  industrial  complex,  whatever  they  call  it,  and 

10  they  must  operate  this  way,  looking  at  what's  best,  they 

11  provide  knowledge,  whatever  it  is.    But  they  tend  to  see 

12  the  world  as  a  delivery  mechanism  in  which  the  new  context 

13  is  the  stimulus  and  kids  learn  the  response.    And  that  is 

14  appropriate  to  help  some  design,  I  guess. 

15  There  is  another  world  that  is  polarized  out 

16  there  that  is  180  degrees  different  in  which  the  kids  are 

17  the  stimulus,  and  teaching  is  the  response.    Just  like  in 

18  medicine,  the  patient  is  the  stimulus  and  what  the  doctor 

19  prescribes  is  the  response. 

20  Those  two  worlds  don't  connect.    And  what  is 

21  missing  is  what  in  biology  is  called  osmosis,  an  agent 

22  that  allows  two  things  that  don't  connect  to  exchange  what 

23  they  both  need  to  exchange  what  they  both  need,  the 

24  information  they  both  need,  nutrients,  if  I  go  back  to  my 

25  culture  definition  before,  to  be  able  to  take  what  they 
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1  need  when  they  need  it.    That  is  what  everybody  is  talking 

2  about. 

3  We're  talking  about  trusted  neutral  groups  that 

4  overlap,  that  don't  connect,  they  can't  connect,  their 

5  time-frames  are  different,  their  problems  are  different, 

6  they're  not  supposed  to  connect.    But  we  need  these 

7  mechanisms  that  allow  us  to  get  what  we  need  for  each 
other  based  on  mutual  understanding  and  trust.    And  the 
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9         lab  program  can  be  a  vital  resource  in  that. 

10  i  just  want  to  say  we're  behind  the  program  and  I 

11  hope  you  can  turn  it  into  paper  that  will  communicate  to 

12  the  people. 

13  MR.  STALFORD:    Could  I  ask  you  a  question  about 

14  your  comments,  about  the  comments  about  the  Congress?  I 

15  recognize  the  reality  of  what  you're  saying  that  labs  do 

16  provide  information  to  the  Congress,  I  recognize  that.  In 
a  formal  sense  the  mission  of  a  lab  is  to  deliver  services 
to  a  region  and  that  doesn't  preclude  doing  other  things. 
But  I'm  tying  to  sort  through  the  implications  of  what  you 
were  saying  about  Congress  as  an  audience? 

MS.  STONER:    It  was  definitely  an  audience.  I 

22  guess  I  don't  understand  your  question.    They  are  policy 

23  makers.    They  are  the  reason  that  the  laboratories,  the 

24  centers,  and  all  the  centers  and  National  Center  for 

25  Education  Statistics,  in  the  sense  that  they  have  listened 
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1  to  the  public  and  have  the  authorization  for  these 

2  particular  entities.    They  have  oversight  responsibility 

3  and  in  that  oversight  responsibility  they  are  policy 

4  makers.    And  so  I  think  it's  a  very  critical  part  of  the 

5  thinking  about  what  to  do. 

6  MS.  EARLEY:    In  other  words,  what  Dena  is  saying 

7  here,  I  think,  we  all  have  to  remember  when  we  go  up  and 

8  have  little  chats  with  members  of  Congress  in  our 

9  respective  roles,  they  will  often  say  what  are  the 

10  implications  of  that  for  my  state?    And  that  is  where  the 

11  labs  become  important.    If  there  is  a  resource  that  serves 

12  their  states  or  region,  they're  going  to  turn  to  that 
resource  and  say,  okay,  I'm  here  representing  New  Mexico. 
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14  I  want  to  know  how  this  is  goiny  have  an  impact  on  New 

15  Mexico.    So  maybe  they're  going  to  go  to  the  Southwest  Lab 
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and  say  can  you  peoi  e  tell  me  how  this  is  going  to  impact 

17  on  New  Mexico,  and  those  people  are  using  some  particular 

18  expertise. 

19  i  think,  perhaps,  that  is  more  how  the  labs  are 

20  going  to  influence  federal  policy.    By  making  the 

21  connections  between  the  districts  and  states  they 

22  represent  and  some  of  the  particular  substantive  issues 

23  that  might  l»e  under  consideration. 

24  MR.  MACK:    John,  did  you  have  a  comment? 

MR.  HOPKINS:    It's  along  the  same  line  that  Penny 
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was  saying,  that  I  have  no  dlificulty  seeirg  it  as  a 
responsibility  of  mine  to  inform  representatives  from  my 
region  as  to  the  condition  of  education  in  my  region. 
They  may  work  here  in  Washington,  but  they  are 
representatives  of  people  in  the  Mid  Atlantic  region.  And 
so  I  am  performing  an  information  function  for  them. 

MR.  SMITH:    Any  other  comments?    Thank  you  all, 
this  has  been  a  very  good  sess  -on. 

(Whereupon,  at  11:55,  the  meeting  was  was 
concluded. ) 
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PROC.EEDINGS 

HEARING     OFFICER  EGERMEIER: 
Perhaps  we  should  begin. 

Thank  you  all  for  coming. 
This  will  be  a  small  intimate  group 
today.  There  will  be  a  few  people 
coming  during  the  day,  but  the  purpose 
of  the  meeting,  as  you  know  is  to 
simply  provide  an  opportunity  for 
anyone  who  wishes  to  come  in  on  a  face- 
to-face  basis  and  make  a  presentation 
of  their  views  as  an  alternative  to 
putting   it   in   the  mail. 

We  are  taking  the  turn  out 
as  much  of  an  indication  or  perhaps 
more  indication  of  the  type  of  budgets 
of  both  time  and  travel  as  it  is  in  the 
indication   of  interest. 

We  have  heard  a  lot  --  we 
have  heard  from  a  lot  of  people  by  mail 
on  these  programs. 

Now,  the  format  for  the 
meetings  is  that  I  will  lead  each  of 
these  meetings,  and  read  into  the 
record     a     standard     preparatory  state- 
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ment. 

And  so  I  will  do  this  first 
and  then  we  will  proceed  with  the 
presentations . 

I  am  John  Egermeier  of 
0  E  R  I  ,  the  Office  of  Education  and 
Research  a  d  Improvement,  U.  S  . 
Department   of  Education. 

This  is  one  of  three  open 
meetings  at  which  the  public  may  make 
suggestions  to  OERI  about  the  future  of 
the  regional  educational  laboratory 
program  in  connection  with  the 
forthcoming  recompetition  of  existing 
awards  to  operate  the  laboratories. 

A  fact  sheet  about  the 
mer  ings  is  available.  It's  been 
passed  out,  plus  copies  of  a  notice 
about  the  meetings  printed  in  the 
Federal   Register  on  June   23rd,  1989. 

The  purpose  of  these 
meetings  is  to  extend  an  opportunity 
for  interested  groups  and  individuals 
to  submit  their  views  and  advice  on 
educational   needs   and  priorities   and  on 
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ways  the  regional  educational  labora- 
tories can  be  most  responsive  to  those 
needs  . 

Thase  views  are  being 
sought  by  OERI  to  assist  planning  for 
the  forthcoming  r e c o m p e t i t i o n  of 
existing  avaros  to  operate  labora- 
tories . 

OERI  seeks  the  individual 
views  of  the  presenters  or  the 
organizations  they  represent  at  these 
meetings,  not  a  consensus  of  the 
participants . 

As  indicated  in  the  Federal 
Reg  ist er  notice,  OERI  is  especially 
interested  in  seeking  views  and  advice 
from  the  public  on  the  following 
issues : 

One,  what  activities 
conducted  by  the  regional  laboratories 
have  been  most  valuable  in  the  past  two 
or  three  years? 

Two,  how  can  regional 
laboratories  contribute  to  improving 
performance    of    our    educational  system 
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--  what  are  the  key  issues  and  problems 
that  they  should  address   in  the  future? 

Three,  what  kinds  of 
laboratory  activities  and  strategies 
(for  example,  syntheses  and  other 
research  and  development  products, 
direct  technical  assistance,  training 
and  capacity  building,  et  cetera)  would 
be  most  beneficial    in  the  future? 

Four,  what  form  of 
relationships  between  laboratories  and 
other  organizations  or  persons  seeking 
improvement  in  schools  would  be  roost 
ef  f ect ive? 

I  will  chair  the  meeting. 
Persons  wishing  to  make  a  statement  at 
these  meetings  have  been  assigned  ten- 
minute   blocks  of  time. 

I  request  that  each 
presenter  identify  herself  or  himself 
and,  if  appropriate,  the  organization 
or  group  they  are  representing  before 
making  their  statement. 

Presenters  are  also  asked 
to     leave     a     written     copy     of  their 
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statements    with    me    before    leaving  the 

room,    if  possible. 

A  verbatim  transcript  will 
be  made  of  presentations  at  this 
meeting,  and  also  of  presentations  at 
the  other  two  meetings  being  held  this 
week  . 

The  reporter  at  the  table 
here  is  present  for  that  purpose.  OERI 
will  make  the  transcripts'  publicly 
available  to  anyone  interested  in  the 
recompetition. 

Other  papers  and  reports 
related  to  the  recompetition  are  also 
available  to  the  public.  An  order 
form  for  these  documents  has  been 
distributed  and  is  available  to  any  who 
are  interested. 

Persons  in  attendance,  but 
not  presenting  today,  plus  others  in 
the  public,  may  also  submit  written 
statements  directly  to  OERI  on  the 
issues   stated  previously. 

Such  statements  should  be 
sent  to  OERI   at  the   address   in   the  fact 
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sheet  and  be  mailed  by  July  21st. 

Are     there     any  questions 
about   today's  meeting. 

(No   response . ) 

HEARING  OFFICER  EGERMEIER: 
If  there  are  no  questions,  we  will 
begin,  and  the  first  presenter  for  the 
day  is  Dr.  Lee  Droegemueller ,  Commis- 
sioner of  Education  for  the  State  of 
Kansas . 

Thanks.  This  is  not  an 
amplified.  It  is  a  recorder.  If  you 
are  unable  to  hear  because  of  the 
acoustics  here,  you  may  want  to  move 
up.      But  give   them  a  try. 

DR.    DROEGEMUELLER:  They'll 

all   hear  me . 

HEARING     OFFICER  EGERMEIER: 

All  right. 

DR.      DROEGEMUELLER:  Well, 
I'm     Commissioner     Lee  Droegemueller, 


Chief    State    School    Officer    from  Kansa 
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and  a  member  of  the  Board  cf  Directors 
of  the  MidContinent  Regional  Education 
Laboratory . 
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I  am  here  today  in  my  role 
as  a  client  of  McREL  that  serves  the 
State  of  Kansas. 

McREL  provides  numerous 
educational  services  to  the  State  of 
Kansas.  That  includes  the  Legislature, 
the  State  Department  of  Education,  our 
Regional  Service  Centers  and  individual 
school  districts. 

As  a  Chief  Executive  of  the 
state  educational  agency,  McREL  is  made 
available  to  me,  "think  tank"  re- 
sources, risk  capital  in  small  amounts 
and  the  most  important  is  the  human 
resources.  The  human  beings,  the 
expertise  that  they  bring  us  and  their 
people . 

McREL  staff  provides  up-to- 
date  research  and  assistance  to  state 
agencies  through  publications, 
consultations   and  educational  meetings. 

For  eyample,  Research  Round 
Up  is  a  monthly  publication  with  brief 
reports  and  cutting  edge  studies, 
projects   and  programs. 


A  second  publication, 
Noteworthy  provides  concise  but  in- 
depth  coverage  of  significant  educa- 
tional issues.  And  I  say  concise,  it's 
very  important  in  today's  rushing  time 
expanding  world  to  have  concise  reports. 
And  those   are   just  excellent. 

Probably  one  of  the 
highlights  of  this  past  year  was  the 
conference  sponsored  by  McREL  in  our 
region.  That  conference  was  the  School 
Year  2020. 

It  brought  international 
experts  in  education  to  our  region. 
Kansas  legislators,  State  Board  members 
and  staff  attended  the  conference  with 
McREL 1 s    financial  assistance. 

This  meeting  and  McREL' s 
Rural  Education  Development  Project 
were  extremely  instrumental  in  bringing 
to  our  state's  attention  the  need  for 
restructuring  or  rethinking  our 
educational  needs  in  view  of  interna- 
tional  economic  and  educational 
compet  i t  ion . 
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Preparation  for  this 
conference  and  follow-up  by  McREL  staff 
were  instrumental  in  setting  the  stage 
for  additional  state  funding  of  at-risk 
students,  innovation  and  change.  In 
fact,  that  will  contribute  --  the  state 
will  contribute  around  $5  million 
dollars  this  next  year  for  that 
specific  purpose. 

McREL  staff  members,  such 
as  Shirley  McCune  provide  nationally 
recognized  assistance  to  the  Depart- 
ment . 

Dr.  McCune  helped  draft  the 
international  award  winning  Strategic 
Plan.  Following  the  Strategic  Plan, 
Dr.  McCune  and  her  staff  designed  and 
conducted  a  job  audit  of  SEA  employees 
that  resulted  in  recommendations  for 
organizing  staff  to  implement  the 
Strategic  Plan. 

Other  consultants  such  as 
Brian  Hall  came  to  Topeka  and  talked  to 
the  State  Board  and  agency  staff  about 
organizational    values    and    change  after 
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the    administration    completed    a  values 
assessment  instrument. 

This  particular  project  has 
been  very  instrumental  in  redeveloping 
and  redesigning  our  State  Department. 
So   it  was   very  much   beneficial   to  us. 

Robert  Carkuff  further  will 
provide  further  strategic  planning 
assistance  with  the  support  of  our 
regional  laboratory. 

McREL  staff  also  consulted 
with  us  on  outcomes  accreditation.  Dr. 
McCune  has  worked  closely  with  a  group 
of  staff,  legislators  and  superinten- 
dents on  establishing  an  educational 
indicator  system,  which  will  show  how 
well  the  education  system  is  doing  in 
Kansas . 

I  especially  appreciate  the 
assistance  in  the  equity  issues  that 
Shirley  McCune  has  given  to  our  staff. 
This  type  of  information  and  expertise 
takes  year  to  acquire,  and  even  more 
years  to  make  work. 

Many    students    and  teachers 
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that  takes  on  a  regional  perspective. 

It  is  my  view  that  state 
universities  or  individual  state 
agencies  could  not  easily  offer  this 
highly   needed   regional  perspective. 

I  might  add  along  with 
that,  the  economic  scans  of  the 
region,  the  Mid-America  crisis  that 
we're  now  facing  are  just  part  of  the 
work  that's  being  done  with  McREL  and 
our   legislature  and   our  State  Board. 

McREL  provides  a  national 
voice  for  issues  that  transcend  the 
region.  Because  the  laboratory's  staff 
members  spend  so  much  time  in  the 
field,  their  expertise  is  grounded  in 
the    realities    of    educational  practice. 

This  region  has  tradi- 
tionally had  strong  public  schools,  and 
what  is  being  learned  here  can  make  a 
contribution  to  improving  the  quality 
of   education  nationally. 

McREL  is  a  vehicle  for 
getting  skill  knowledge  as  well  as 
research     knowledge     into     the  national 
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discussion     about     how     education  might 
best  be   improved   and  changed. 

Our  regional  laboratory  is 
one  of  the  major  forces  assisting  our 
state  agency  in  the  educational 
restructuring  needed  as  we  move  into 
the  twenty-first  century. 

The  regional  and  national 
perspective  of  McREL  is  not  available 
in  other  existing  research  and  planning 
agencies   in   our  area. 

The  highly  competent  staff 
and  their  ability  to  work  with  all 
levels  of  educational  personnel  is  even 
a   greater   as  set . 

Kansas  education  and  our 
state  agency  very  much  need  the 
continued  support  of  our  regional 
laboratory . 

HEARING  OFFICER  EGERMEI ER : 
Thank  you.  Let  me  just  ask  if  the 
reporter  has   any   clarifying  questions? 

THE    REPORTER  :        No  .  Thank 

you . 

HEARING     OFFICER     EGERMEI ER : 


Thank  you  very  much. 

Our  next  scheduled  speaker 
is  Dr.  Richard  Phillips  of  the  Missouri 
Department  of  Education. 

Since  he  is  not  here,  we 
will   take  a   short  recess. 

I  understand  that  the  third 
speaker  Dr.  Earl  Jensen  was  scheduled 
and  he  won't  be  here.  So  we  will  just 
take  a  short  recess  until  we  see  if  Dr. 
Phillips   will   be  arriving. 

(Off  the    record . ) 

HEARING  OFFICER  EGERMEIER : 
We  are  ready  to  resume,  and  continue 
the  morning   session  here. 

Our  next  presenter  is  Dr. 
Richard  Phillips  of  the  Department  of 
Education   in  Missouri. 

Dr .    Phill ips . 

DR.       PHILLIPS:  Good 

morning. 

My  name  is  Richard  Phillips 
and  I  am  employed  by  the  Missouri 
Department  of  Elementary  and  Secondary 
Education   for  the   State   of  Missouri. 
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Before  I  begin  let  me  state 
to  you  the  procedures  that  I  will  go 
through  and  also  to  give  you  informa- 
tion regarding  the  support  that  our 
agency   has   for  what   I   am  about   to  say. 

I  visited  last  night  with 
our  Commissioner  of  Education  and  the 
members  of  our  staff,  and  what  1  have 
to  say  is  supported  by  our  Commissioner 
and  by  the  members  of  our  staff.  So  I 
represent   our  agency. 

In  terms  of  the  structure 
of  how  I  will  address  these  remarks,  I 
have  prepared  written  comments  that  I 
have  submitted.  I  will  use  that  as  an 
outline   and   speak   from  that. 

And  hopefully,  I  will  give 
a  clear  picture  of  some  of  the 
activities  that  we  have  been  involved 
in  with  the  lab  over  the  last  several 
years . 

It  always  a  pleasure  to 
come  together  colleagues  and  visit 
about  positive  activities  that  are 
occurring    within    our    state    and  across 
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 c  

the  country,  and  specifically  to  speak 
regarding  the  assistance  that  we 
receive  from  our  colleagues  at  the  lab. 
So   I   am  glad  to  be  here. 

I  have  worked  with  McREL 
for  the  past  eight  years  on  a  number  of 
projects     and     a     number     of  activities. 

And  I  will  not  in  this 
short  period  of  time  be  able  to  cover 
everything  that  we've   been    involved  in. 

I  will  speak  specifically 
to  those  items  that  I  have  been 
involved  in  personally  or  that  the 
members  of  my  staff  have  been  involved 
with. 

In  1983-P4  school  >  ;ar,  we 
began  to  develop  computer  c  usters 
across  the  state  for  the  purpose  of 
providing  in-service  training  to  school 
officials  in  small  out-state  schools  in 
Missouri. 

McREL  provided  the 
direction  and  leadership  in  seeing  that 
activity  come  to  fruition.  One  of  the 
unique    components    of    this    activity  was 
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not  just  the  computer  clusters  itself, 
but  the  Department  became  an  active 
member  of  that  participant. 

In    one    cluster    we    had  six 
school   districts   that    formed   a  cluster, 
of    which    the    Department    was    an  equal 
partner    through    funds    provided    by  the 
lab  . 

The  interesting  charac- 
teristic of  this  cluster  was  that  the 
cluster  of  the  co-op,  if  you  will, 
employed  a  computer  consultant  to 
provide  in-service  training  to  the 
staff  members  in  those  school  districts 
and   also  to  the  Department. 

Prior  to  that  time  our 
Department  had  no  in-service  activities 
for  the  utilization  of  any  computers  at 
all . 

In  December  of  1983  122 
members  of  our  staff  went  to  a  series 
of  in-service  activities  provided  for 
by  Tony  Sander,  who  was  employed  by 
this  computer  cluster  to  provide  in- 
service  training. 
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At  that  time  our  agency  had 
one  computer  that  was  housed  in  the 
Commissioner's    office    and    no    one  used 


it 


After     that     time  staff 


members  began  to  see  the  need  and  the 
advantage  of  utilizing  microcomputers 
for   a  variety   of  activities. 

At  this  time  we  have 
microcomputers  on  the  desk  of  all 
professional  and  support  staff  members 
throughout   the  agency. 

Accessing  information  today 
is  much  different  than  what  it  would 
have  been  had  we  not  had  this  assis- 
tance  early  on . 

Not  only  did  this  computer 
cluster  provide  unique  opportunities 
for  the  staff  members  in  those  small 
schools,  but  it  was  a  direct  link  for 
our  agency  in  improving  upon  the 
quality  of  services  that  we  provided  to 
the     545     school     districts     across  the 


state  . 


The       utilization  of 
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computers  for  information  management 
became  a  real  object  for  us.  Today  we 
are  going  through  a  massive  revision 
of  all  of  our  data  systems  that  center 
around  utilizing  information  for  the 
purpose  of  improving  services  to  the 
school   districts    in   the  state. 

That  could  not  have  been 
realized  without  the  assistance  that  we 
had  several  years  ago  in  beginning  the 
staff  training  and  the  things  that  we 
did  . 

This  assistance  from  Tony 
Sander,  who  was  a  part  of  this  cluster 
was  supported  by  McREL  for  three  years. 
Tony  became  essentially  a  member  of  our 
staff  and  was  the  computer  expert  that 
provided  service  -  -  in-service  training 
to  the  school  districts  across  the 
state . 

We  used  this  person  to  help 
improve  the  efficiency  of  the  utiliza- 
tion of  computers  for  school  districts 
across  our  state.  And  it  was  a  very 
important     activity     for     us,     not  only 
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internally,  in  terms  of  how  we  managed 
information  and  the  utilization  of 
computers  for  a  variety  of  activities, 
but  it  also  improved  upon  the  use  of 
computers  throughout  the  state  on  the 
part  of   school  officials. 

Another  component  that  we 
tried  to  work  with  during  this  period 
of  time  was  to  examine  who  we  delivered 
services   to  schools. 

One  of  the  things  that  we 
did  with  the  computer  cluster  was  to 
examine  ways  the  Department  could 
improve  upon  efficiency  and  effective- 
ness. 

The  superintendents  in  this 
cluster  were  beginning  to  tell  us  that 
the  exchange  of  data  was  overburdensome 
and  was  causing  undue  hardships  and 
taking   insurmountable   amounts   of  time. 

We  then  began  to  work  with 
Tony  Sander  in  developing  a  data 
exchange  that  I  think  is  the  only  one 
in   the  country. 

Again,     keep     in     mind  that 
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all  of  this  was  supported  by  McREL 
during   this   period  of  time. 

We  have  an  interactive  edit 
package  for  exchanging  data.  In  the 
classification  program  that  I  ad- 
minister, it's  a  personnel  file  of  all 
school  teachers,  all  administrators 
giving  their  class  assignments,  their 
salary,  the  kinds  of  things  that 
they're  involved  in,  the  years  of 
experience,    et  cetera. 

All  that  is  on  our  data 
file.  With  this  interactive  edit 
package,  school  districts  can  essen- 
tially edit  their  data  before  it  comes 
to   our  department. 

There  are  approximately  500 
edit  checks  built  into  this  system  that 
allow  school  districts  to  edit  the  data 
before   it  comes   to  our  agency. 

In  other  words,  if  a  school 
official  is  filling  out  particular 
information  on  a  staff  member  and 
leaves  out  salary,  there  is  an  error 
message   that   is   given  at   that  time. 
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If  a.  school  official  wants 
to  know  how  many  people  in  that 
district  are  being  paid  by  our  are 
intended  to  be  paid  by  state  funds,  the 
computer,  this  system  will  also  tell 
them  that. 

It  will  give  them  different 
printouts  regarding  the  number  of 
Chapter  One  people,  vocational  people, 
et  cetera,  that  the  school  district 
has. 

So  school  officials  can 
essentially  edit  and  evaluate  their 
data  before  it  comes  to  our  agency. 
The  savings  in  this  has  been  tremen- 
dous . 

Prior  to  this  time  when 
data  would  come  into  our  office,  it 
would  come  in  essentially  unedited, 
dirty,  if  you  will,  with  missing  pieces 
of  data. 

We  would  turn,  as  it  would 
come  into  our  office,  the  office  that  I 
administer,  we  would  spin  the  data  off 
for     special     education     people,  for 
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Chapter     One     people,      for  vocational 
people,    Chapter  One  gifted,    et  cetera* 

They,  in  turn,  would  then 
call  the  school  district  to  clean  up 
the  data.  They  would,  after  they  would 
get  the  clean  data  from  the  school,  it 
would  be  transmitted  back  to  our 
office. 

It  took  an  unbelievable 
amount  of  time.  All  of  that  has  now-- 
is  now  taken  care  of  by  our  office.  If 
a  person  has  missing  data,  which  is 
very  rare  at  this  time,  in  special 
education,  that  information  comes 
d  irect ly  to  us . 

School  officials  are  no 
longer  called  by  special  education 
staff,  vocational  staff,  preschool, 
gifted,  whatever,  for  pieces  of  data. 
That   comes  through   our  office. 

It    has  to    give    you  an 

example,  in  special  education  we  have 
ten  consultants.  Those  people  from  the 
first  of  October  to  the  middle  of 
December     have     historically  called 
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school  districts,  spent  that  period  of 
time,  calling  school  districts  for 
clean  data,    updated   data,    et  cetera. 

Now,  those  people  no  longer 
do  that.  Tbey  are  able  to  provide 
direct  service  to  the  public  schools  in 
the  state  either  through  staff 
training,  other  means  of  technical 
assistance . 

So  the  relief  of  data 
burden  for  them  because  of  this 
interactive  edit,  has  been  tremendously 
beneficial  to  the  schools  of  our  state 
and   also  to  the  work  of  our  agency. 

And  again,  I  submit  to  you, 
this  is  the  only  one  of  its  kind  in  the 
country  that  we're   aware  of. 

And  to  repeat  myself,  this 
gives  school  officials  an  opportunity 
to  examine  and  clean  the  data  before  it 
comes  to  our  office.  It  has  been 
extremely  beneficial  to  all   of  us. 

The  in-service  professional 
growth  opportunities  that  have  been 
provided    to    us    through   McREL   have  been 
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unending. 

in  July  of  1982  myself  and 
the  members  of  our  staff  were  pri- 
vileged to  attend  the  meeting  in 
Snowmass,  Colorado,  which  we  began  to 
seriously  look  at  the  effect  of 
school's    research    on    better  schooling 


practices 


A  s 


result      of  that 


meeting,  the  McREL  provided  for 
members  of  our  staff  --  in  Jefferson 
City  for  117  members  of  our  staff  -two 
days  in-service  regarding  a  miniature 
agenda  of   this  activity. 

From    that    agenda,    which  by 
the    way,    was    the    first    time,    and  I've 
been  with  the   Department   ten   years,  and 
I    was    a    superintendent    prior    to  that 
for  seven   years,    so   in   a   seventeen  year 
period    of    time    as    far    as    I    can  tell, 
that  was  the   first   time  that  members  of 
our     Department     were     called  together, 
members     of     the     vocational  staff, 
special    ed    staff,    et    cetera,    were  able 
to    come    together    in    the    same    room  and 
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begin  to  examine  issues  and  began  to 
address  the  issue  of  how  we  can  improve 
upon  the  quality  and  quantity  of 
services  provided  to  the  citizens  of 
our  state. 

That     was     the     first  time 
that    that    had    ever    happened.  Again, 
this  was  provided   to   us  by  McREL.  From 
that    meeting    began    to    emerge    a  series 

of   activities . 

I  administer  the  classi- 
fication program.  We  have  ten  state 
supervisors  of  instruction  that  live  in 
the  region,  various  regions  of  the 
state  and  work  directly  with  the 
school s . 

They  are  the  lead  people  in 
administering  the  Department's 
prog  rams . 

In  1983,  August  of  1983, 
McREL  began  to  provide  for  us  a  series 
of  ir-service  activities  for  those  ten 
state  supervisors  of  instruction.  And 
that  practice  or  that  service  has 
continued  through   this  day. 
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We  .have  in-service 
activities  planned  for  our  state 
supervisors    of    instruction    the   week  of 

August   the  14th. 

And,    again,    the    results  of 
these     kinds     of     activities     have  been 
tremendous.       For    us    to   have   the  vision 
and     expertise     of     individuals  outside 
our     agency     has     been  tremendously 
beneficial   to  us   in  planning  strategies 
and    providing    direction    in    how    we  can 
improve    upon    the     quality     of  services 
that    we   provide    to   the    citizens    of  our 
state . 

As  a  result  of  the  1982 
Snowmass  meeting  and  the  meetings  that 
followed,  meetings  with  our  state 
supervisors  of  instruction  through  the 
in-service  activities  provided  by 
M  c  R  E  L  ,  began  to  emerge  a  different 
attitude  about  how  we  assess  the  school 
programs  and  services  that  are  provided 
in   the  local  districts. 

We  began  to  take   a  critical 
look     at     how     we     assess     and  evaluate 
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school  district's  programs  and 
services.  And  thus,  began  to  emerge  a 
new  look  which  we  are  now  referring  to 
as  the  Missouri  School  Improvement 
Program,  which  I  submit  to  you  is 
probably  the  most  exciting  thing  that's 
happen ing  across  the  country  at  this 
time. 

We  are  in  the  process  of 
looking  at  how  we,  not  only  assess 
school  district's  programs  and 
services,  and  we're  designing  a  system 
that  we  hope  is  fair  and  accurate,  but 
a  system  that  more  importantly  perhaps 
provides  structures  of  support  to  the 
544   districts   in   our  state. 

Recognizing  that  each 
district  is  different  with  different 
sets  of  characteristics,  with  each 
district  being  placed  in  a  different 
type  of  community. 

It  is  important  that  we 
assess  the  school  district  based  upon 
its  resources  and  based  upon  its 
ability    to    do    the    best    it    can    and  at 
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the    same   time    challenging    the  district 
to  continue  to  improve. 

But  this  system  has  built- 
in  levels  of  support.  What  has 
happened  as  a  result  of  McREL's 
continued  involvement  in  this  activity 
has  emerged  a  change  of  philosophy  of 
monitoring  programs  that  we  have 
historically  done,  where  we've  gone  in 
a  district  and  said  such  things  as, 
you're  out  of  compliance,  we're  going 
to  withhold   state  aid. 

I     submit     to     you,  that's 
very    helpful.       That   s    a    pun.       From  a 
system     of     walking     in     to     a  school 
district  with   a  team  approach,    the  team 
approach     being     individuals     from  our 
Department,    from   institutions   of  higher 
education,     from    the    professional  ranks 
of   the   public   schools,  superintendents, 
assistant    superintendents,  principals, 
teachers,    et   cetera,    board  members,  lay 
people     from    the    community,  presidents 
of    the    Chamber    of    Commerce,  president 
of   the   School   Board,    et  cetera. 
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But  grouping  a  team  of 
people  to  examine  a  school  district 
based  upon  a  predetermined  set  of 
criteria  and  assess  how  that  district 
is  doing  based  upon  that  criterion, 
more  important  that  team  has  a 
responsibility,  as  I  said  a  while  ago, 
of  providing  structures  of  support  for 
that   school  restrict. 

The  team's  responsibility 
is  to  assist  the  school  district  in 
identifying  resources  for  improvement 
in  the  areas  of  concern  and  also 
developing  a  set  of  recommendations  or 
a  series  of  recommendations  to  address 
those   a  r  e  a  r>   of  concern. 

Thus,  began  to  emerge  a 
system  of  what  we  refer  to  as  school 
improvement . 

The  second  component  to 
this  new  school  improvement  program  and 
equally  important  to  us,  is  the  fact 
that  we  currently  administer  the 
various  programs  and  services  within 
our   agency   on  an   independent  basis. 
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The  .  special  education 
people  have  their  own  system  of 
administering  the  special  education 
programs  across  the  state,  as  do  the 
vocational  programs,  Chapter  One, 
preschool,  finance,  food  service  and 
around   it  goes . 

There  are  approximately  28 
different  programs  and  services  that  we 
have  the  authority  to  monitor  and 
admin  ister  . 

The  new  school  improvement 
program  is  focused  on  an  integrated 
cooperative  review  format,  in  which  the 
school  district  will  receive  a  review 
of  all  the  programs  and  services  that 
the  Department  has  the  authority  to 
administer  in  one  shot,  instead  of  the 
28  independent  reviews,  all  of  which 
have  their  own  administrative  style, 
all  of  wnich  have  their  own  unique 
characteristics  of  how  they  are 
administered . 

But    this,     the    team  review 
approach,     focusing    on    school  improve- 
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ment  and  the'  integrated  review 
collapsing  all  of  the  various  com- 
ponents of  the  Department's  programs 
and  services  into  one  review  is 
extremely  beneficial  to  the  school 
districts   of  the  state. 

This  coming  year  will  be 
the  third  and  last  year  of  a  piloting 
process  of  which  McREL  has  actively 
participated  in  the  team  reviews  with 
us  to  critique  how  well  we  are  doing, 
to  provide  guidance  and  assistance  as 
to  how  we  develop  an  administrative 
structure  for  administering  this 
program,  to  providing  direct  assistance 
to  the  Commissioner,  the  State  Board  of 
Education  and  myself  and  other  who  are 
working  with  this  program. 

And,  again,  I  submit  to 
you,  as  I  view  the  activities  of  our 
Department  I  think  and  as  I  look  at 
what's  happening  across  the  country,  T 
think  this  is  one  of  the  most  exciting 
projects   that   is   currently  occurring. 

And,    again,    McREL    has  been 
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an    equal    partner    in   helping   us  develop 

2 

the  style   for  this  process  and  also  the 
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administrative  procedures. 
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As     I     visit     with  other 

5 

members   of   our  staff   and  as   I  indicated 
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to    you    last    night    our    Commissioner  of 
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Education     on     some     of     the     things  I 
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wanted     to     say,     recognizing     the  time 
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limitations     that     I     would     have,  we 
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agreed  that  we   feel   that   this   is   a  very 
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unique  period   of   time   in   the  history  of 
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public     education,     and     also     a  very 
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unique  period  of  time   in   the   history  of 
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our  Department. 
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activities     that     we     are     involved  in 
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being   very   helpful    to   the    five  million 
plus  citizens  of  our  state. 

And,  again,  McREL  has  been 
a  unique  partner  in  helping  us  arrive 
at  that  goal  or  help  us  work  toward 
that  goal. 

And,  again,  we  think  we're 
in  a  very  unique  period  of  time  in  the 
history  of  our  department  and  the 
public  education  of  otir  state.  And 
i*  1  s  exciting  and  refreshing  to  have 
those  that  you  can  depend  on  be  a  part 
of   that   activity . 

There    is    much    more    I    could  | 
say     about     our     involvement     with  McREL 
because     there      are      a     variety  of 
activities  that   they   have   been  involved 
in   with   us • 

The  Commissioner  wanted  me 
to  mention  two  items  to  you  that  are 
not  a  part  of  the  written  record 
because  our  conversation  was  last  night 
and  I  already  had  this  worked  up  that  I 
need  to   submit   to  you. 

We  are   aware   that   the  chief 
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state  school  pfficers  across  the 
country  have  a  concern  about  redis- 
tributing the  money  that  goes  to  the 
lab  directly  to  the  State  Departments 
of  Education. 

Both  the  Commissioner  and  I 
and  other  members  of  our  staff  feel 
like  this  would  be  the  downfall  of  the 
quality  of  service  that  we  currently 
receive. 

Having  an  independent  lab, 
such  as  McREL,  not  a  part  of  our  agency 
gives  us  a  fresh,  bright  realistic  look 
at  the  problems  and  issues  that  we  deal 
wi  t  h . 

If  those  monies  were  to  be 
transmitted  to  the  alate  Department  of 
Education  we  would  be  strapped  by  the 
inadequate  funding  issues  that  we 
currently  have. 

We  would  suffer  from  the 
acute  inability  to  attract  the  quality 
of  people  that  currently  exist  on  the 
McREL  staff  because  of  our  low  salary 
and     ridiculous     fringe     benefits  that 
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exist. 

So  having  the  money 
redistributed  in  that  fashion  would  be 
a  detriment  to  the  quality  of  services 
that  we   currently  receive. 

We  are  able  to  receive  an 
unbiased,  fresh,  clear  vision  of  what 
the  issues  really  are  from  someone 
other  than  members  our  own  staff. 

This  gives  us  an  indepen- 
dent review  of  what's  occurring  across 
the  country,  across  the  world  and  we 
feel  as  though  if  these  monies  were 
distributed  to  our  staff  for  us  to 
employ  people  with  the  political 
restraints  that  we  have  relative  to 
funding,  the  limitations  that  we  would 
have  would  be   a   detriment   to  us. 

The  other  issue  that  we 
wanted  to  bring  before  you  was  the 
concern  of  long-term  funding.  When  we 
began  this  crusade,  if  you  will,  or 
this  enthusiastic  interest  in  redesign- 
ing our  assessment  practices,  that 
activity,    as   I   said,    began   to   unfold  in 
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1982-83  and  th«n  in  1983-84,  more 
spec  if  ical ly  . 

Now,  that's  been  a  long 
time  ago.  And  there  are  those  critics 
who  will  say,  why  don't  you  move 
quicker,  and  the  fact  that  we  move 
with  glacieral  speed. 

When  you  move  a  structure, 
when  you  change  a  structure  such  as  we 
are  dealing  with  with  the  classifica- 
tion program,    it  takes   a   lot   of  time,. 

There  are  a  lot  of  people 
involved  with  varying  interests.  We 
have  the  political  arena  that  we  must 
deal  with. 

We  have  the  reality  of 
turnover  in  staff.  We  have  the  reality 
of  dealing  with  5  4  5  different  com- 
munities, different  political  struc- 
tures  across  the  state,    et  cetera. 

The  need  for  long-term 
support  for  this  kind  of  an  effort  is 
critical  to  the  success  of  what  we  dp, 
not  only  what  we  are  currently  involved 
in    but    the   things   that   we   have  planned 


for  the  next  century. 

And  we  would  submit  to  you 
that  the  current  structure  of  funding 
and  administering  the  regional  labs,  at 
least  in  our  case,  McREL,  is  something 
that  we  would  support  on  an  ongoing 
basis  and  encourage  those  that  have 
administrative  authority  over  the  labs 
to  direct  situations  that  would  entail 
long-term  support. 

I  would  be  pleased  to 
answer  any  questions  that  you  have  at 
this  time,  and  I  would  conclude  very 
quickly  to  say  o  you  that  we  view 
McREL  as  being  our  professional 
colleagues,    as  our  friends. 

To  be  able  to  call  and  say, 
I  have  a  problem  and  have  immediate 
feedback,  whether  it  be  from  the  Kansas 
City  office  or  from  the  Aurora  office 
is  very  refreshing  and  very  supportive 
to   us  . 

To  be  able  to  have  people 
critique  written  materials,  to  be  able 
to   have   people  help  us  plan  strategies, 
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is  extremely  important  to  us. 

Yesterday,  Larry  Hutchings, 
Susan  Everett  of  McREL  met  with  the 
Commissioner,  myself  and  the  members  of 
our  staff  to  help  us  plan  strategies 
about  the  1989-90  school  year  relative 
to  the  implementation  of  our  school 
improvement  program  which  is  designed 
to   be    implemented  July   1,  1990. 

I  will  meet  with  McREL 
staff  members  tomorrow  and  Friday  with 
other  members  of  my  staff.  And  those 
are  the  kind  of  activities  that 
continue   on  an  ongoing  basis. 

It  is  extremely  important 
to  us.  It's  important  to  the  citizens 
of  our  state  that  this  support 
continue  . 

I  thank  you  for  your 
consideration.  Again,  I  would  answer 
any  question  that  you  would  have  at 
this  time. 

HEARING  OFFICER  EGERMEI ER : 
Thank  you.  We  appreciate  you  taking 
the  time  to  come   in  and  provide  us  with 
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a   statement .      It'.s  very  worthwhile. 

DR.     PHILLIPS :         I  enjoyed 

being  here . 

HEARING  OFFICER  EGERMEIER: 
Our  next  speaker  is  George  Krumrey,  who 
was  scheduled  for  the  afternoon 
presentation,    but  we  would   like   to  hear 

from    him  now . 

George     Krumrey     is  president 
of    the    Iowa    Parent    Teacher's  Associa- 
tion   and    is    a    member    of    the    Board  of 
the    North    Central    Regional  Educational 
Laboratory . 

Mr .    Krumrey . 

MR  .      KRUMREY :  I  t      i  s  a 

pleasure    to    be    with    you    this  morning, 
and   thank   you   for   this  opportunity. 

As  was  stated,  I  am  George 
Krumrey  of  Des  Moines,  Iowa*  I  am  a 
Lutheran  parish  pastor  and  president  of 
Iowa  PTA,  and  also  a  member  of  the 
Board  of  Directors  of  the  North  Central 
Regional   Educational  Laboratory. 

Although  I  have  not  seen  a 
list   of  those  who   are  presenters,    I  may 


be   one   of    a   kind   here   today,    in    that  I 
am  not  a  professional  educator. 

In  Nelson  Smith's  recent 
cover  letter,  I  am  in  the  last  group 
mentioned,    the  general  public. 

Our  region  believed  it 
advisable  to  send  such  a  person  here 
for,  among  others,  these  two  reasons: 
It  is  the  general  public  who  foot  the 
bills  directly  and  indirectly  for  all 
the  goods  things  that  are  being 
mentioned   here  today. 

And  also,  the  bottom  line 
of  it  all  is  what  it  does  for  the 
children  and  youth  in  the  educational 
process,  children  and  youth  from  the 
entire  spectrum,  including  the  gifted 
and  talented  to  those  who  are  at  risk 
of  throwing  in  the  educational  towel 
and   quitting  school. 

My  remarks  in  general  will 
follow  the  major  issues  enumerated  on 
Page  264  03  of  the  June  23rd  Federal 
Register . 

Since   I   can   in   no  way  speak 
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for  or  about  the  other  eight  labs,  I  am 
speaking     as     a     representative     of  the 

North  Central  Lab. 

It  is  difficult  for  me  to 
evaluate  accurately,  in  a  comparative 
manner,    but  I  will   mention  three. 

One  is  the  increasing  use 
of  telecommunications-supported  staff 
development.  This  is  particularly 
useful  in  rural  areas,  in  enabling 
educators  to  keep  abreast  of  specific 
strategies  for  school  improvement  and 
restructuring. 

Realizing    always  that 
reading    is    still    fundamental,    a  second 
excellent      project      has     been  the 
Wisconsin     Rural     Reading  Improvement 
Project. 

Our  region  decided  that 
instead  of  doing  a  little  of  this  in 
all  of  our  states,  we  would  focus  on 
one  state,  and  that  has  been  Wisconsin, 
as  sort  of  a  pilot  project.  And 
obviously  with  the  success  it  has 
achieved     in     Wisconsin,     we     expect  to 
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expand  it. 

And  thirdly,  we  obviously 
have  large  cities  in  our  region,  such 
as  Cleveland,  Columbus,  Ohio,  Detroit 
and   Chicago . 

Among  our  initiatives  for 
those  schools  is  the  Accelerated 
Schools  Action  Project.  And  I  am 
leaving  a  couple  copies  of  a  summary  of 
our  labs  work  in  it's  five-year 
h  istor y . 

One  other  project  that  was 
especially  meaningful  to  me  was  a 
three-day  conference  on  at-risk 
students   held   last  August   in  Chicago. 

People  from  different 
professional  disciplines  as  well  as 
parent  representatives,  like  myself, 
had  the  privilege  of  attending. 

I  found  it  exceedingly 
worthwhile  and  useful.  And  among  the 
papers  I  have  here  is  a  summary  of  that 
conference . 

How  can  regional  lab£ 
contribute    to    improving    performance  of 
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our  educational  system?  In  my  opinion, 
they  can  do  the  most  by  servicing,  by 
various  means,  as  a  clearinghouse,  in 
two  primary  ways:  Among  the  states  in 
the  region,  and  among  the  various 
segments   of  the  educational  community. 

They  can  help  prevent  a 
duplication  of  effort  and  wasted 
expenditures,  and  at  the  sams  time  look 
for  cracks  in  the  educational  frame- 
work. 

Communication  is  so  very 
important.  In  North  Central  we  have 
102  more  or  less  official  receiv- 
ing/disseminating "partners,"  who  help 
serve  as  our  antennae  as  to  what  is 
new,  what  is  needed  and  what  works 
best. 

Aiding  in  this  communica- 
tion are  our  publications  such  as 
Policy  Briefs.  a  new  bimonthly 
publication  reporting  briefly  on 
significant  educational  policy  issues, 
such  as  strategies  for  preventing 
dropouts   and   open  enrollment. 
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Another  gem  has  been  in 
existence  longer,  the  ncrel  CLIPBOARD, 
sort  of  a  potpourri  of  what's  new  in 
educational   thinking  and  practice. 

These  are  loose  sheets  done 
in  what  I  call  bit  size  for  busy  people 
to  get  the  information  rather  guickly 
and  easily. 

Regarding  what  is  needed 
for  the  future,  I  would  say  all  the 
help  that  we  can  get  and  give  toward 
marketing  what  I  consider  a  fine 
educational  system.  I  think  we  all 
realize  that  America's  public  schools 
have  been  under  heavy  attack  in  recent 
years.  And  they  are  not  perfect,  but 
some  of  the  raw  materials  that  our 
schools  receive  present  a  tremendous 
cha 1 lenge . 

We  need  to  market  our 
schools  better  to  combat  the  negativism 
of  our  critics.  And  I  know  of  some 
fine  examples  of  such  marketing,  such 
as  the  middle  school  where  my  wife  is  a 
teacher     associate      in     Des  Moines. 
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They're  doing  an.  excellent  job,  as  is 
the  whole  Des  Moines  District  on 
marketing  our  schools. 

At  the  same  time  we  need  to 
remind  the  public  we  are  always  open  to 
their  constructive  criticisms.  A 
continuing  need  across  the  nation  is 
more  parental  involvement. 

And     I     think     our  schools, 
our     school     districts,     our     states  and 
our     regional      labs     need     to  give, 
perhaps,    more    attention    to   what   we  can 
do   for  greater  parental  involvement. 

A  goal  of  each  regional  lab 
should  be  to,  as  much  as  possible,  help 
erase  or  overcome  state  boundaries,  and 
generate  more  and  more  collegiality  and 
teamwork . 

The  seven-a-year  NCREL 
regional  forums  are  an  example  of  more 
teamwork,  more  working  together  across 
state  lines. 

Regarding  the  form  of 
relationships  between  laboratories  and 
organizations     seeking     improvement,  I 
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would  say  that,  our  state  advisory 
committees  we  have  in  the  North  Central 
Region,  when  they  are  operating  as 
intended,  are  ideal,  as  they  bring 
together  state  educational  agencies, 
higher  education,  professional 
associations   and   parents   for  dialogu-e. 

The     right     hand     must  know 
what  the   left  hand   is  doing  and  why. 

I  have  here  a  number  of 
publications  that  have  come  out  through 
out  North  Central  Lab,  some  are 
original  with  our  people  and  some  they 
have  simply  printed  to  make  available 
to  more  people. 

Some  have  to  do  with  rural 
education.  One  that  particularly 
caught  my  attention  is  entitled 
America's  Third  World,  a  reprint  from 
Newsweek  Magazine. 

And  it  talks  about  a 
segment  of  a  population  that  is  quite 
separated  from  those  of  us  in  the 
middle  and  the  upper  social-economic 
class. 


But  they  are  there,  they 
are  among  us,  they  have  needs  and 
rights  just  as  we  do.  So  I  have  a 
number  of  NCREL  publications  here. 

Thank  you,  and  if  any  have 
any  questions,  I  will  be  glad  to  hear 
them  . 

HEARING  OFFICER  EGERMEIER: 
Thank  you,    Mr.  Krumrey. 

That  will  conclude  our  on- 
the-record  presentations  until  further 
not i  ce . 

(Whereupon,    the  meeting  was 

cl osed . ) 
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I,  DIANE  MARSH,  do  hereby 
certify  that  I  appeared  at  the  time  and 
place  first  hereinbefore  set  forth;  that  I 
took  down  by  means  of  cassette  recording 
the  entire  proceedings  h.ui  at  said  time  and 
place;  and  that  the  foregoing  pages  1 
through  51  constitute  a  true,  correct  and 
complete  transcript  of  my  said  cassette 
recordings. 
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1  PROCEEDINGS 
2 

3  (9:10) 

4  MR.  STALFORD:    Good  morning,  my  name  is  Charles 

5  Stalford  from  the  OERI  staff.    This  is  one  of  three  open 

6  meetings  this  week  at  which  the  public  may  make 

7  suggestions  to  OERI  about  the  future  of  the  Regional 

8  Educational  Laboratory  Program  in  connection  with  the 

9  forthcoming  recompetion  of  existing  awards  to  operate 

10  laboratories.    A  fact  sheet  about  these  meetings  is 

11  available  in  this  room.     I  think  most  of  you  have  it.  It 

12  is  in  the  back,  plus  copies  of  a  notice  about  the  meetings 

13  printed  in  the  Federal  Register  on  June  23,  1989. 

14  The  purpose  of  these  meetings  is  to  extend  an 

15  opportunity  for  interested  groups  and  individuals  to 

16  submit  views  ana  advice  on  educational  needs  and 

17  priorities  and  on  ways  that  the  Regional  Educational 

18  Laboratories  can  be  most  responsive  to  these  needs.  These 

19  views  are  being  sought  by  OERI  to  ascist  planning  for  the 

20  forthcoming  recompetition  of  existing  awards  to  operate 

21  laboratories.    OERI  seeks  the  individual  views  of  the 

22  presenters  for  the  organizations  they  represent  at  these 

23  meetings,  not  a  consensus  of  the  participants  who  are  here 

24  today. 

25  As  indicated  in  the  Federal  Register  notice,  OERI 
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1  is  especially  interested  in  seeking  views  and  advice  from 

2  the  public  on  the  following  issues:    What  activities 

3  conducted  by  the  Regional  Educational  Laboratories  have 

4  been  most  valuable  in  the  past  two  to  three  years?  How 

5  can  Regional  Laboratories  contribute  to  improving 

6  performance  of  our  educational  system?    What  are  the  key 

7  issues  and  problems  that  they  should  address  in  the 

8  future?    What  kinds  of  laboratory  activities  and 

9  strategies,  for  example,  syntheses  and  other  research  and 

10  development  products,  direct  technical  assistance, 

11  training  and  capacity  building,  and  the  like,  would  be 

12  most  beneficial  in  the  future?    Fourth,  what  form  of 

13  relationships  between  laboratories  and  organizations  or 

14  other  persons  seeking  improvement  in  schools  would  be  most 

15  effective? 

16  I  will  Chair  this  meeting  this  morning.  Persons 

17  wishing  to  make  a  statement  at  these  meetings  have  been 

18  assigned  ten  minute  blocks  of  time.    I  request  that  each 

19  presenter  here  identify  him  or  herself,  and  if 

20  appropriate,  your  organization  or  group  which  you  are 

21  representing  at  the  start  of  your  statement.    You  are  also 

22  asked  to  leave  a  written  copy  of  your  statement  with  me 

23  before  leaving  the  meeting.    A  verbatim  transcript  will  be 

24  made  of  presentations  at  this  meeting,  also  of 

25  presentations  at  the  other  two  meetings  being  held  this 
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1  week,  which  are,  incidentally,  in  Kansas  City,  Missouri 

2  today,  and  in  San  Francisco  on  Friday.    The  Reporter,  Rita 

3  Shepard,  to  my  right  at  the  head  table  here,  is  pr  sent 

4  for  this  purpose. 

5  OERI  will  make  the  transcripts  publicly  available 

6  to  anyone  interested  in  the  recompetition.    Other  papers 

7  and  reports  related  to  the  recompetition  are  also 

8  available  to  the  public.    An  order  form  for  these 

9  documents  is  in  the  back  of  the  room,  and,  indeed,  the 

10  papers  and  the  documents  themselves  are  there,  if  you 

11  would  like.    As  I  indicated  before,  if  you  don't  want  to 

12  carry  them  and  would  like  us  to  ship  them  to  you,  thore  is 

13  an  order  form.    So  please  leave  it  with  one  of  us  and 

14  we'll  do  that  for  you. 

15  Persons  in  attendance,  but  not  presenting  today, 

16  plus  others  in  the  public,  may  also  submit  written 

17  statements  directly  to  OERI  on  the  issues  stated 

18  previously.    Such  statements  should  be  sent  to  OERI  at  the 

19  address  on  the  Federal  Register  notice,  to  be  mailed  by 

20  July  21st.    Are  there  any  questions  about  today's  meeting? 

21  We  have  a  schedule  of  people  to  start  at  9:20. 

22  We  are  scheduled  at  ten  minute  periods,  continuously, 

23  until  10:10,  when  one  of  the  persons  who  was  to  make  a 

24  statement  has  called  in  ill  and  said  she  will  not  be  able 

25  to  come.    There  will  then  be  a  break  —  actually  the  next 
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1  person  who  was  going  to  complete  the  morning  also  called 

2  in  ill,  although,  she  said  her  statement  could  be  read 

3  into  the  record,  and  we  may  do  that.    So  we  do  have  some 

4  flexibility  here  this  morning. 

5  The  meeting  is  scheduled  to  go  on  this  afternoon. 

6  It  was  an  open  invitation,  and  at  this  time,  to  my 

7  knowledge,  there  is  one  person  scheduled  to  make  a 

8  statement  at  1:20,  otherwise  we  will  be  here  if  members  of 

9  public  wish  to  come  and  make  a  statement.    So  I  would 

10  request  this  morning  that  you  try  and  keep  within  the 

11  ten-minute  limit  out  of  consideration  for  folks  who  may 

12  have  schedules  and  things  to  do  beyond  the  time  they  are 

13  assigned;  however,  I'm  not  going  to  ring  a  gong,  at  least 

14  right  away.    If  you're  concerned  about  that,  please  let  me 

15  know  when  you  start,  and  if  you  need  to  say  something 

16  further,  perhaps  we  can  arrange  it  in  a  free  space  of  time 

17  later.    But  let's  try  and  keep  within  the  time  limit. 

18  Our  first  speaker  who  has  requested  to  speak  is 

19  Denise  Alston  of  the  Children's  Defense  Fund.     Denise  I 

20  suggest  you  come  up  here  and  use  the  podium,  if  you  like, 

21  and  feel  free  to  talk  to  the  group  here. 

22  MS.  ALSTON:    Good  morning.     I'd  like  to  thank  the 

23  Department  of  Education  for  giving  me  and  the  Children's 

24  Defense  Fund  an  opportunity  to  share  our  thoughts  on  the 

25  Regional  Educational  Laboratories.    My  name  is  Dr.  Denise 
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1  Alston,  and  I'm  the  Senior  Education  Associate  at  the 

2  Children's  Defense  Fund  here  in  Washington, 

3  The  Children's  Defense  Fund  is  a  national 

4  advocacy  organization  for  the  children  of  America  who  can 

5  neither  vote,  lobby,  nor  speak  for  themselves.    We  pay 

6  particular  attention  to  the  needs  of  poor,  minority  and 

7  handicapped  students.    Our  goal  is  to  educate  the  country 

8  about  the  needs  of  children  and  encourage  preventive 

9  investment  in  children  before  they  get  sick,  drop  out  of 

10  school,  or  get  into  trouble.    Our  staff  includes 

11  specialists  in  health,  child  welfare,  mental  health,  child 

12  development,  adolescent  pregnancy  prevention,  youth 

13  employment,  and  education. 

14  our  education  agenda  is  focused  on  poor  and 

15  minority  children  who  live  in  isolated  pockets  of  poverty, 

16  who  attend  the  poorest  schools,  whose  communities  have  the 

17  least  social  and  economic  resources.    We  are  focusing  on 

18  this  group  because  we  believe  that  these  youngsters  are 

19  most  likely  to  have  been  overlooked  or  inadequately  served 

20  by  recent  education  reform  efforts;  and  we  are  encouraging 

21  researchers,  practitioners,  and  policymakers  to  focus 

22  their  efforts  over  the  next  decade  on  these  youngsters. 

23  Evidence  shows  that  poor  and  minority  youngsters 

24  in  isolated  rural  and  urban  areas  are  not  benefitting 

25  sufficiently  from  education  reform.    For  example,  we  know 


1  approaches  that  work  to  improve  the  learning  of  students 

2  who  have  been  put  at  risk  of  school  failure. 

3  My  mission  here  today  is  to  charge  the  Labs  to  do 

4  more  and  to  integrate  what  they  do  for  at-risk  students 

5  with  what  they  do  for  all  children. 

6  In  the  interest  of  time,  I'll  simply  read  through 

7  a  list  of  recommmendations  for  activities  which  I  have 

8  determined  to  either  be  lacking  in  the  Labs'  current 

9  efforts  or  deserve  greater  attention.    That  greater 

10  attention  might  include  staff  development  for  a  broader 

11  range  of  teachers  and  administrators;  more  extensive 

12  implementation,  that  is,  moving  successful  practices  from 

13  small  pilots  within  a  few  schools  to  broader 

14  demonstrations  affecting  a  larger  number  of  students, 

15  ultimately  leading  to  full  implementation  throughout  a 

16  school  system;  or  wider  dissemination  of  results,  such 

17  that,  for  example,  effetive  practices  with  limited  English 

18  proficient  students  in  the  Southwest  are  adapted  for 

19  implementation  in  the  Northeast  and  Mid  Central  regions 

20  where  there  are  also  growing  populations  of  youngsters 

21  with  first  languages  other  than  English. 

22  My  specific  recommendations  are  for  the  Regional 

23  Educational  Laboratories  to  develop  alternatives  to 

24  grouping  and  tracking  which  will  result  in  success  for  all 

25  students;  alternatives  to  grade  retention  for  students  who 
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1  fall  behind,  focusing  on  regular  assessment  and  quick 

2  intervention  when  a  student's  progress  first  begins  to 

3  lag;  practices  which  encourage  and  enable  teachers  to 

4  minimize  labeling  students  as  learning  disabled,  behavior 

5  disordered,  or  educable  mentally  retarded?  practices  which 

6  enable  teachers  to  keep  students  who  are  so  labelled  in 

7  the  regular  classroom  receiving  regular  instruction; 

8  approaches  that  ensure  limited  English  proficient  students 

9  will  receive  the  common  core  of  basic  and  higher  order 

10  skills  while  learning  English;  culturally  sensitive 

11  curriculum  that  appeals  to  the  diversity  of  students  and 

12  their  communities;  and  school  restructuring  plans  which 

13  open  school  boundaries  to  coordination  with  social  and 

14  health  services. 

15  I  acknowledge  that  some  of  the  Regional  Labs  have 

16  taken  on  some  of  these  issues.    Yet,  more  must  be  done  by 

17  more  Labs.    We  are  all  aware  of  the  changing  demographics 

18  of  urban  and  rural  schools.    We  see  more  and  more 

19  youngsters  who  are  poor,  ethnic  or  racial  minorities, 

20  living  in  single  parent  homes,  surrounded  by  distressed 

21  communities,  but  yet  these  youngsters  still  must  be 

22  educated  to  become  contributors  to  our  society,  these 

23  youngsters  must  be  educated.    The  Regional  Labs  must  place 

24  these  youngsters  at  the  center  of  their  activities  in 

25  order  to  make  a  significant  impact  on  school  improvement 
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1  and  to  help  raise  national  achievement  levels. 

2  It  is  a  big  challenge,  but  the  Labs'  previous 

3  work  and  talented  staffs  are  up  to  it  if  they  truly 

4  believe  that  all  children  can  and  must  learn.    Thank  you, 

5  MR.  STALFORD:    Thank  you  very  much,  Denise.  The 

6  next  speaker  is  Mary  Beth  Jorgensen,  Federal  Liaison  with 

7  the  Maryland  State  Department  of  Education. 

8  MS.  JORGENSEN:    Good  Morning.    We  in  Maryland  are 

9  active  participants  in  our  Regional  Mid-Atlantic 

10  Laboratory,  Research  for  Better  Schools.    We  have  received 

11  superb  services  and  benefits.    We  support  its  model  as  a 

12  national  one  for  all  Regional  Laboratories  because  it 

13  works  extremely  well.    We  are  pleased  to  comment  on  each 

14  area  in  which  you  seek  views. 

15  In  terms  of  past  activities,  over  the  past  10  to 

16  15  Years,  the  Mid-Atlantic  Laboratory  has  provided  the 

17  Maryland  State  Department  of  Education  with  research  and 

18  background  information,  training  and  technical  assistance, 

19  and  process  and  summary  research  on  all  of  Maryland's 

20  educational  initiatives  established  by  the  State  Board  of 

21  Education  and  the  Maryland  legislature.    These  initiatives 

22  include  competency-based  education,  adult  literacy 

23  programs,  pre-kindergarten  education,  school  effectiveness 

24  programs,  graduation  requirements,  MSDE  staff  development, 

25  special  education,  training  of  superintendents,  principals 


Q  U  JL  O 

ERIC 


12 

1  and  supervisors ,  middle  school  education,  students  at  risk 

2  of  school  failure ,  Chaptert  1  programs  for  disadvantaged 

3  students;  and  rural  education, 

4  Key  issues  and  problems  for  the  future •  Our 

5  strategic  planning  process  for  education  has  a  five-year 

6  cycle.    In  the  fall  we  begin  identifying  key  issues  and 

7  problems  facing  the  state  during  1991  through  1996.  The 

8  Regional  Laboratory  will  be  an  active  participant  in  the 

9  twenty-step  planning  process,  which  also  involves  input 

10  from  the  general  public,  to  identify  Maryland's  major 

11  educational  goals  and  focus  on  the  State  Department  of 

12  Education's  resources. 

13  During  the  first  two  years  of  this  planning 

14  cycle,  the  Department's  action  plan  calls  for  the 

15  following?  review  the  statewide  minimum  competencies; 

16  restructure  vocational  technical  education;  expand 

17  programs  for  homeless  youths;  incorporate  technology  into 

18  education  —  computers,  VCRs,  interactive  television; 

19  expand  minority  staff  recruitment;  develop  parental 

20  involvement  program  components;  participate  in  national 

21  longitudinal  studies;  implement  students-at-risk  programs, 

22  rural  school  plans,  retraining  programs  for  experienced 

23  teachers,  school  based  acountability  procedures,  and  early 

24  and  middle  years'  education  policies  and  procedures.  Many 

25  of  these  are  continuous  programs  involving  the  support  and 
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1  expertise  of  the  Regional  Laboratory. 

2  Laboratory  activities  and  strategies  for  the 

3  future  can  include  —  our  Regional  Laboratory  staff  is 

4  involved  with  us  in  planning,  implementing,  and  evaluating 

5  State  programs  and  projects-    Activities  include  research, 

6  product  development,  synthesis  of  current  literature, 

7  process  observation,  capacity  building  of  State  Department 

8  and  local  school  system  personnel,  and  technical 

9  assistance. 

10  In  addition,  because  we  work  regionally,  the  five 

11  states,  the  District  of  Columbia  included,  share  in 

12  conferences,  training  of  new  State  Department  personnel, 

13  and  visitation  projects. 

14  Today  while  this  meeting  is  taking  place,  four 

15  staff  members  of  the  Regional  Laboratory  are  working  with 

16  forty  Maryland  State  Department  of  Education  staff  members 

17  in  a  workshop  with  two  purposes.    One,  to  share  successful 

18  projects  that  we  might  use  from  other  states;  and  two,  to 

19  synthesize  and  enable  us  to  use  the  research  on  the 

20  national  topic  of  restructuring  schools.    These  activities 

21  and  strategies  give  you  examples  of  specific  Regional 

22  Laboratory  activies.    We  have  attached  to  our  testimony  a 

23  copy  of  the  most  recent  Maryland  fact  sheet  prepared  by 

24  RBS  summarizing  activities  from  January  1st  through  June 

25  30,  1989. 
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1 

In  the  future,  our  issues  and  problems  will 

2 

change  ar  /e  try  to  meet  new  educational  and  societal 

3 

needs.    The  activities  and  strategies  will  remain  similar 

4 

as  we  train  new  staff  members  to  respond  to  and  resolve 

5 

new  problems.    Our  laboratory  staff  provide  us  with 

6 

current  skills  which  enable  us  to  make  changes.  The 

7 

laboratory  staff  is  our  best  resource  and  partner.  They 

8 

have  a  primary  mission,  and  they  do  it.    They  work 

9 

one-to-one,  collectively  as  a  region,  and  nationally  to 

10 

network  us  with  others  who  can  assist  us.    We  see  no  other 

11 

federal  assistance  that  is  so  responsive. 

12 

Relationships  with  others.    We  know  from 

13 

experience  that  decisions  made  by  those  closest  to  the 

14 

issue  produce  the  best  results.    That  is  the  philosophy  of 

15 

block  grants  and  other  federal  programs.    We  believe  it  is 

16 

and  should  continue  to  be  true  of  the  Regional 

17 

Laboratories. 

18 

Currently,  the  Lab  is  our  only  vehicle  to  serve 

19 

regional  needs  that  have  been  identified  by  the  several 

20 

states.    The  laboratories'  Boards  of  Directors, 

21 

representing  state  and  local  superintendents  of  schools 

22 

and  members  of  the  community  within  the  region, 

23 

collectively  focus  on  unique  problems  and  issues. 

24 

Once  a  key  issues  for  the  future  is  identified  on 

25 

a  regional  and  state  basis,  we  recommend  that  the  Labs  and 
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1  states  form  coalitions  with  appropriate  associations  and 

2  organizations  to  assist  in  seeking  and  actually 

3  implementing  solutions.    We  believe  that  the  Labs  should 

4  be  mandated  to  form  such  relationships  with  such 

5  associations  and  organizations  willing  to  commit  time, 

6  staff,  and  resources. 

7  MR.  STALFORD:    Thank  you,  Mary  Beth.    The  next 

8  speaker  is  Reuben  Pierce,  who  we  have  listed  as  Principal 

9  of  Ballou  High  School.     I  believe  Rueben  is  actually 

10  Acting  Administrator  of  Ballou  High  School  where  he  was  a 

11  principal  earlier.    He  is,  otherwise,  Assistant 

12  Superintendent  in  the  District  of  Columbia  Public  Schools. 

13  MR.  PIERCE:    Thank  you,  Mr.  Stalford.  I 

14  appreciate  this  opportunity  to  speak  to  you  and  to  the 

15  members  of  the  OERI  staff  who  are  present  about  the 

16  recompetition  of  the  Regional  Educational  Laboratories. 

17  For  three-and-a-half  years  in  the  past,  and  on  a 

18  temporary  basis  in  the  present,  I  did  serve  as  the 

19  Principal  of  Ballou  Senior  High  School,  which  is  located 

20  in  one  of  the  poorest  sections  of  the  District  of 

21  Columbia.    I  also  served  as  an  Assistant  Superintendent  in 

22  the  District  of  Columbia  Public  Schools  for  another  12 

23  years.    I  have  worked  extensively  with  Research  for  Better 

24  Schools  on  the  improvement  of  secondary  education,  and  my 

25  testimony  is  bas  d  on  that  experience. 
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1  I  will  comment  on  all  four  questions  on  which  you 

2  are  seeking  advice.    But  the  bulk  of  my  testimony  will  be 

3  directed  toward  the  question  which  asks  about  the  value  of 

4  Regional  Laboratory  activities. 

5  Valuable  Regional  Educational  Laboratory 

6  activities.    Part  of  my  experience  with  RBS  occurred 

7  within  the  framework  of  the  Mid-Atlantic  Metropolitan 

8  Council,  which  is  composed  of  the  five  largest  public 

9  school  districts  in  the  Mid-Atlantic  region.    This  Council 

10  was  created  by  RBS  to  enable  the  superintendents  and 

11  others  from  the  central  office  staffs  of  the  Baltimore, 

12  Newark,  Philadelphia,  Pittsburgh,  and  Washington,  D.C. 

13  school  districts  to  join  together  to  work  on  problems  of 

14  common  concern. 

15  Improving  secondary  education  was  the  first 
problem  area  identified  by  the  Council.    I  might  add  that 

17  it  was  in  this  context,  in  the  context  of  our  creating  a 

18  new  Division  of  Secondary  School  Improvement  in  Washington 

19  that  I  became  most  intimately  involved  with  RBS. 

20  Along  with  that,  RBS  conducted  a  major  study  of 

21  ten  high  schools,  two  in  each  of  the  five  school 

22  districts,  which  has  been  very  helpful.    The  study  found 

23  that  commitment  to  the  learning  enterprise  on  the  part  of 

24  teachers,  principals,  and  students  is  vital  to  the 

25  successful  operation  of  effective  secondary  schools. 
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1  The  results  of  this  study  have  been  used  for 

2  staff  development  purposes  in  several  of  the  Metropolian 

3  Mid-Atlantic  school  districts.    Other  districts  are  using 

4  them  to  guide  the  development  of  their  long-range  plans 

5  for  improving  secondary  education.    Following  the 

6  commitment  stu<<y,  the  RBS  staff  worked  with  all  five 

7  districts  to  improve  the  teaching  of  critical  thinking 

8  skills.    Individualized  projects  were  started  in  each  of 

9  the  districts  and  are  continuing  today.    RBS  staff  are 

10  providing  information,  models,  and  training  on  how  to 

11  incorporate  thinkinr;  skills  into  the  curriculum. 

12  Also  as  part  of  the  project,  RBS  arranged  for 

13  teachers  and  administrators  to  visit  the  schools  with 

14  thinking  skills  projects  in  other  districts,  most  recent 

15  of  which  was  a  v^.sit  to  the  Newark  Public  School  District. 

16  These  visits  supplemented  other  demonstrowions  which  took 

17  place  at  the  semi-annual  meetings  of  the  Council"  which 

18  rotated  from  one  of  the  five  school  districts  to  another, 

19  such  as  a  visit  we  made  to  the  Schenley  High  School 

20  Teacher  Training  Center  in  Pittsburgh. 

21  Another  example  of  RBS'  work  involved  a  number  of 

22  high  school  academies  we  were  operating  in  different 

23  career  areas.    This  program  was  being  offered  in 

24  conjunction  with  some  active  public  and  private 

25  partnerships.    We  arranged  for  RBS  to  evaluate  this 
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1  program.    The  evaluation  was  conducted  in  a  very 

2  professional  manner,  and  the  program  manager  and  staff 

3  were  provided  precisely  the  information  they  needed  in 

4  order  to  improve  the  program  still  further. 

5  Based  on  my  personal  experiences  in  working  with 

6  RBS,  then,  I  would  say  that  they  have  provided  the 

7  following  valuable  services:    their  work  in  convening  and 

8  organizing  the  five  largest  school  districts  in  the 

9  Mid-Atlantic  region  into  a  council  was  valuable  because  it 

10  greatly  increased  the  interaction  among  the  professional 

11  staffs  of  these  districts.    Some  of  the  superintendents 
^.2  had  not  met  one  another  prior  to  the  formation  of  the 

13  Council,  and  this  was  also  true  of  most  of  the  central 

14  office  counterparts. 

15  As  a  result  of  our  meeting  in  one  anothers' 

16  districts,  we  saw  programs  at  all  levels  which  sparked  our 

17  interest,  enthusiasm,  and  sense  of  what  was  possible.  It 

18  is  probably  worth  noting  at  this  point  that  no  other 

19  agency  in  the  region  has  the  assignment  to  convene  school 

20  district  personnel  in  this  way;  it  is  a  function  that  is 

21  unique  to  the  Regional  Laboratories,  and  as  this 

22  illustration  shows,  it  is  a  valuable  function,  indeed. 

23  The  research  RBS  conducted  in  the  commitment 

24  study  was  valuable  to  us  in  that  it  provided  concepts  and 

25  recommendations  which  were  incorporated  into  our  inservice 
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1  programs  and  our  planning  of  future  improvements  in 

2  secondary  education.    The  results  of  the  research  have 

3  also  been  disseminated  by  RBS  beyond  the  region  to  the 

4  rest  of  the  country.    As  part  of  the  thinking  skills 

5  activity,  RBS  provided  training  to  teachers  who  went  on  to 

6  train  other  trainers  in  our  districts.    They  also  provided 

7  us  information  on  models  and  promising  practices  elsewhere 

8  which  were  useful  in  expanding  our  ideas  about  directions 

9  we  could  go  and  objectives  we  could  achieve. 

10  In  conducting  the  evaluation  of  the  Public 

11  Private  Partnerships  Program,  RBS  staff  provided  the 

12  detailed,  person-specific  information  the  program  manager 

13  and  staff  needed  in  order  to  improve  their  program,  even 

14  though  that  kind  of  information  is  not  often  found  in  an 

15  evaluation  report. 

16  All  these  activities  were  valuable,  and  I 

17  recommend  that  all  of  the  functions  be  continued  in  the 

18  next  Laboratory  Competition. 

19  i  shall  now  go  on  to  address,  briefly,  the  three 

20  other  questions  on  which  you  are  seeking  public  advice. 

21  With  contributions  to  improved  perfovmance,  Regional 

22  Laboratories  can  best  contribute  to  the  improved 

23  performance  of  our  educational  systems  in  the  future  by 

24  concentrating  a  significant  portion  of  their  resources  on 

25  a  few  large-scale,  long-term,  major  efforts  to  improve  the 
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1  performance  of  students,  particularly  students  who  are  at 

2  risk  of  failure.    They  should  continue  to  provide  the  kind 

3  of  valuable  services  I've  described  above,  but  have  great 

4  potential  for  improving  the  education  of  poor  and  at-risk 

5  students. 

6  These  projects  can  revolve  around  a  variety  of 

7  topics,  such  as  governance,  instructional  approaches, 

8  parental  involvement,  or  community  partnerships,  but  they 

9  should  always  be  of  sufficient  scope  and  magnitude  to  have 

10  the  potential  for  very  significant  change  and  improvement. 

11  Here  is  another  place  where  the  services  of  a 

12  laboratory  are  particularly  valuable.    When  a  laboratory 

13  can  commit  its  support  to  a  project  on  a  long-term  basis, 

14  those  who  are  planning  the  project  are  encouraged  to  reach 

15  a  little  farther  and  iare  a  little  more  than  they  would 

16  otherwise,  thus  producing  the  potential  for  even  greater 

17  improvement  than  would  be  attempted  if  the  practitioners 

18  had  to  do  it  all  on  their  own.    It  is  very  reassuring  to 

19  have  a  partner  who  can  be  counted  on  for  the  long  haul. 

20  As  for  further  activities  and  strategies,  as  I've 

21  already  indicated,  I  think  laboratories  should  continue  to 

22  do  many  of  the  same  things  they  are  doing  now,  but  also 
?3  concentrate  some  of  their  resources  so  that  they  can 

24  assist  with  some  school-level  efforts  to  achieve  dramatic 

25  change.    In  terms  of  strategies,  this  would  mean  that  they 
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1  should  continue  to  work  with  and  through  other  agencies 

2  and  associations  to  some  extent  but  should  also  be  given 

3  the  opportunity  to  provide  direct  services  to  a  few 

4  selected  schools  in  order  to  bring  about  significant 

5  change  in  those  sites. 

6  I  would  add  one  point  here  that  I  didn't  complete 

7  in  the  written  statement.    That  is,  perhaps,  one  of  the 

8  most  significant  contributions  that  I  think  that  the  Labs 

9  could  contribute  is  the  empowerment  of  those  districts  to 

10  do  those  things  on  their  own  by  providing  the  training, 

11  models,  and  research  data  to  enable  them  to  carry  forth 

12  those  programs  independently  because  there  is  no 

13  bottomless  wealth  to  support  this  kind  of  activity. 

14  The  relationship  of  the  Lab  to  other 

15  organizations  is  a  matter  which  can  best  be  determined  by 

16  each  Lab's  Board  of  Directors.    They  are  selected  to 

17  represent  the  region  and  are  in  the  best  position  to 

18  decide  what  should  be  done,  where,  with  whom,  and  under 

19  what  conditions. 

20  Mr.  Stalford,  I  appreciate  this  opportunity  to 

21  advise  you  about  the  the  future  of  the  Regional  Laboratory 

22  Program  from  my  point  of  view.    I  commend  you  for  opening 

23  up  the  recompetition  process  in  this  way.    And  I  hope  that 

24  the  ideas  and  suggestions  that  you  receive  in  these 

25  hearings  will  lead  to  a  more  valuable  Regional  Laboratory 
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1  Program  in  the  next  five  years.    Thank  you. 

2  MR.  STALFORD:    Thank  you,  Dr.  Pierce.     May  I  ask 

3  you  a  short  question ,  please?    It  was  not  our  intent  to 

4  engage  in  a  question  and  answer  period,  but  on  a  specific 

5  issue,  do  you  literally  mean  to  work  with  individual 

6  schools  as  opposed  to  school  districts? 

7  MR.  PIERCE:     School  districts.     I  think  in 

8  certain  instances  in  working  with  school  districts,  there 

9  may  be  —  well  for  example,  in  our  secondary  school 

10  improvement  efforts,  we  actually  would  need  assistance 

11  from  people  from  RBS  to  work  with  specific  schools.  And 

12  in  part  of  that,  or  an  out-growth  of  that  was  the  training 

13  of  people  in  our  district  to  carry  forward  the  kinds  of 

14  things  that  RBS  would  demonstrate  using  specific  schools. 

15  MR.  STALFORD:     Thank  you  very  much.    Next  speaker 

16  is  Geraldine  Rodgers,  teacher,  former  teacher  and 

17  researcher. 

18  MS.  RODGERS:    Good  morning,  I'm  Geraldine 

19  Rodgers.     I'm  here  to  speak  about  the  Regional  Educational 

20  Laboratories . 

21  The  primary  educational  problem  in  America  is 

22  funtional  illiteracy.    Any  research  which  establishes  its 

23  cause  and  its  cure  should  get  the  highest  priority  when 

24  the  Federal  Government  underwrites  future  educational 

25  research.    Yet,  to  judge  from  past  history,  J*  is  most 
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1  unlikely  future  applicants  will  plan  effective  literacy 

2  research.    It  is  therefore  the  responsibility  of  the 

3  Federal  Government  to  insure  such  research  by  requesting 

4  bids  on  specific  work  which  clearly  promises  to  clarify 

5  the  problem. 

6  Bids  should  be  sought  on  four  items  which  I  shall 

7  describe.    I  ask  you  not  to  shirk  your  resposibil-L^  *~o 

8  see  that  tax  dollars  for  research  are  spent  wisely  and 

9  that  you  request  bids  ?n  all  four  items.    Tens  of 

10  thousands  of  reading  comprehension  studies  have  been  done 

11  since  such  tests  first  appeared  about  1914.  Bizarrely, 

12  only  about  a  dozen  oral  reading  accuracy  studies  have  been 

13  done.    Yet  the  worthlessness  of  reading  comprehension 

14  tests  instead  of  oral  reading  accuracy  tests  to  test 

15  reading  ability  was  made  clear  as  early  as  1908,  when  two 

16  master  psychologists  in  France  found  reading  comprehension 

17  to  be  a  function  of  intelligence,  not  reading  skill. 

18  Dr.  Theophile  Simon  wrote  the  following  in  his 

19  1924  book,  "Pedagogie  Experimental^" ,  on  his  work  with 

20  Alfred  Binet  on  the  original  intelligence  tests,  when 

21  children  were  required  to  show  how  much  they  comprehended 

22  of  what  they  read  orally.    Quote:    MWe  have  observed  many 

23  times  this  curious  thing.    It  happens  that  some  children 

24  read  very  incorrectly,  so  incorrectly  that  their  reading 

25  aloud  is,  for  those  who  listen,  very  nearly 
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1  incomprehensible,  and  then,  if  one  asks  them  what  they 

2  have  read,  they  say  it  almost  correctly.    There  is, 

3  therefore,  less  correlation  than  one  could  believe 

4  possible  between  the  understanding  and  the  correctness  of 

5  reading." 

6  Almost  correctly,  of  course,  is  not  good  enough. 

7  But  it  is  this  curious  thing  Binet  and  Simon  observed  in 

8  Paris  in  1908  which  explains  the  current  American  method 

9  of  teaching  reading  by  psycholinguist ic  guessing.  English 

10  has  perhaps  half  a  million  words.    Yet  only  about  300  of 

11  them  compose  about  three-quarters  of  the  words  in  simple 

12  materials.    Children  who  know  about  300  high-frequency 

13  sight  words  and  who  have  been  drilled  in  guessing  from  the 

14  context  as  American  children  constantly  are  drilled,  can 

15  give  the  illusion  of  reading  and  pass  lower  level 

16  comprehension  tests,  just  as  Binet's  subjects  did.  Their 

17  real  reading  failure  will  not  show  until  more  difficult 

18  material,  exactly  where  we  are  hearing  that  our  reading 

19  problem  is  now,  above  fourth  grade  level.    The  only  thing 

20  new  about  teaching  reading  by  psycholinguist ic  guessing  is 

21  the  name.    The  same  approach  appeared  in  the  watershed 
2  readers  of  1930,  W.S.  Gray's  Scott,  Foresman,  "Dick  and 

23  Jane"  readers,  and  A.I.  Gates'  MacMillan  readers. 

24  For  the  record,  both  Gates  and  Gray  had  been 

25  graduate  students  and  friends  of  the  master  American 
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1  psychologist,  E.L.  Thorndike,  and  associates,  like 

2  Thorndike,  of  two  other  master  psychologists,  John  Dewey 

3  and  James  McKeen  Cattell. 

4  The  Gates/Gray  readers  used  a  context-guessing 

5  approach  for  unknown  words,  which  were  carefully  embedded 

6  in  texts  of  memorized  sight  words.    They  did  not  teach 

7  children  to  decode  unknown  new  words  by  true  phonics 

8  because  the  1930  Gates/Gray  reading  method  is  actually  an 

9  ancient  approach  used  to  teach  deaf-mutes  language.  On 

10  page  17  of  Gates'  1930  book,  "Interest  and  Ability  in 

11  Reading"  he  indirectly  admitted  that  connection. 

12  "Becoming  a  Nation  of  Readers,"  the  government- funded  1985 

13  report,  adopts  a  definition  for  reading  on  page  11  which 

14  implies  that  conscious  attention,  or  guessing,  is  required 

15  in  the  indentif ication  of  even  a  single  word.    The  use  of 

16  conscious  attention  in  reading  rules  out  automaticity. 

17  Yet  the  highly  qualified  Dr.  Hilde  Mosse,  the 

18  psychiatrist/pediatrician  who  wrote  "The  Complete  Handbook 

19  of  Reading  Disorders"  in  1982,  considered  the  reading  act 

20  to  be  an  automatic  conditioned  reflex.    She  considered  a 

21  lack  of  automaticity  in  reading  to  be  a  disability.  Her 

22  landmark  work  is  not  cited  in  "Becoming  a  Nation  of 

23  Readers."    Instead,  this  report  implicitly  contradicts  her 

24  and  implicitly  denies  the  possibility  of  automaticity  in 

25  reading. 
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1  Gates  said  in  his  1925  article,  "Problems  in 

2  Beginning  Reading,  an  Analysis  of  21  Courses,"  that  heavy 

3  phonics  was  taught  then  in  almost  all  American  first 

4  grades.    For  reliable  illiteracy  data,  we  must  compare 

5  today's  psycholinguist ic  reading  results  with  results  from 

6  heavy  phonics  before  1926. 

7  The  First  Test:    Gates'  word  lists  reported  in 

8  his  1924  article,  "A  Test  of  Ability  in  the  Pronunciation 

9  of  Words,"  should  be  retested.     In  mid-year  1923-24,  Gates 

10  tested  individually  1,700  pupils  of  grades  one  through  six 

11  in  schools  mainly  in  New  York,  New  Jersey,  Pennsylvania 

12  and  Delaware.    On  Gates'  lists  of  progressively  more 

13  difficult  words,  the  average  score  at  sixth  grade  was  95.5 

14  percent  and  for  14  year-olds  90.9  percent.    Children  for 

15  whom  the  age  was  given  were  obviously  left-backs,  since 

16  children  had  to  stay  in  school  by  law  to  those  ages. 

17  statistically  speaking,  100  percent  of  the  children  at 

18  sixth  grade,  or  old  enough  to  be  in  sixth  grade, 

19  pronounced  over  90  percent  of  the  list. 

20  If  we  could  obtain  a  score  like  that  today,  we 

21  would  have  no  illiteracy  problem.    Yet  the  newer 

22  Gates/McKillop  1963  test  results  on  the  same  word  lists 

23  seem  to  imply  we  do  get  results  like  that.  The 

24  Gates/McKillop  median  score,  at  the  50th  percentile,  is 

25  about  the  same  as  the  1924  average  of  over  90  percent. 
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1  This  is  a  classic  case  to  prove  that  median  and  average 

2  scores  are  not  equivalent.    Very  likely  the  1963  score 

3  shows  that  only  50  percent  of  the  children  average  now 

4  what  100  percent  of  the  children  averaged  in  1924.  Gates' 

5  oral  test  must  be  run  and  marked  to  show  the  average  and 

6  not  the  median  just  as  in  1923-24,  in  order  to  get  hard 

7  data  on  the  drop  in  reading  accuracy  in  grades  one  through 

8  six. 

9  The  Second  Test:    The  correlation  between 

10  spelling  accuracy  and  reading  accuracy  is  very  high. 

11  Leonard  P.  Ayres',  "A  Measuring  Scale  for  Ability  in 

12  Spelling, "  should  be  retested  exactly  as  done  in 

13  1914-1915,  when  he  tested  70,000  children  in  grades  two 

14  through  eight  in  84  American  cities.    These  new  no  ^tis 

15  should  be  compared  to  the  1915  ones  to  show  the  degree  of 

16  retardation.    Children  were  normally  not  permitted  to  drop 

17  out  of  school  in  those  cities  before  about  14  years  of  age 

18  or  older.    Ayres  showed  elsewhere  children  then  were 

19  almost  never  more  than  two  years  below  grade  level. 

20  Therefore,  1915  fifth  grade 

21  scores  represented  virtually  100  percent  of  city  children 

22  in  that  age  group,  and  showed  clearly  virtually  100 

2  3  percent  were  literate,  including  Blacks  and  foreign  born. 
24  If  World  War  I  Army  illiteracy  statistics  should 

2  5  be  cited  in  an  attempt  to  discount  Ayres'  data,  the 
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1  unreliability  of  these  statistics  should  be  made  clear. 

2  The  1917  program  was  run  by  American  psychologists.  In 

3  most  Army  camps,  psychologists  marked  soldiers  illiterate 

4  if  they  had  not  reached  a  specific  graae  level.    It  varied 

5  from  camp  to  camp,  from  fourth  to  eighth  grade.  Abe 

6  Lincoln,  who  only  reached  second  grade,  would  have  been 

7  marked  illiterate  by  the  World  War  I  psycholgists.    In  a 

8  minority  of  camps,  a  so-called  reading  test  was  given. 

9  Draftees  who  were  undoubtedly  nervous  and  distracted  were 

10  scored  as  illiterate  if  they  could  not  answer  enough 

11  comprehension  questions  on  a  news  article  they  had  read. 

12  Their  oral  reading  accural  was  not  tested  so  the  ^est  was 

13  meaningless. 

14  The  Third  Test:    Eye  regression  movement,  means 

15  to  go  back  to  look  again  at  print  already  seen.  Such 

16  movements  can  be  recorded  statistically  with  laboratory 

17  methods,  as  shown  in  Educational  Development  Laboratories. 

18  Research  Information  Bulletin  3,  1960.    Another  kind  of 

19  test  called  oral  reading  error  studies  has  shown  that  even 

20  at  first  grade,  phonically  trained  first  graders  make  far 

21  fewer  regressions.    They  are  obviously  reading  sound,  and 

22  not  going  back  to  check  meaningful  conscious  guesses. 

23  Since  most  American  schools  keep  a  reading  record 

24  on  each  pupil  showing  reading  tests  used  from  first  to 

25  sixth  grade,  and  since  records  follow  the  pupil  to  a  new 
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1  school  when  he  moves ,  it  should  be  simple  to  break  sixth 

2  grades  into  two  groups ,  those  who  learned  with  true 

3  phonics  in  first  grade  and  those  who  learned  with  context 

4  guessing  phony  phonics  plus  sight  words  in  first  grade. 

5  Labeling  of  programs  for  this  test  should  follow  the 

6  guidelines  in  Dr.  Rudolf  Flesch's  carefully  researched 

7  1981  book,  "Why  Johnny  STILL  Can't  Read."    As  Dr.  Flesch 

8  pointed  out,  about,  perhaps,  85  percent  of  American  first 

9  grades  use  textbooks  he  labeled,  "The  Dismal  Dozen,"  which 

10  teach  only  context-guessing  phony  phonics. 

11  With  the  sixth  graders  identified  on  first  grade 

12  methods,  an  eye  movement  study  like  that  of  Educational 

13  Development  Laboratories  should  be  carried  out  to  compare 

14  the  two  methods.    Fewer  regressions  would  indicate  greater 

15  automaticity,  and  numerous  regressions  a  lack  of 

16  automaticity. 

17  The  Fourth  Test:    Methods  are  available  to  tell 

18  if  a  reader  is  using  his  left  or  his  right  brain  memory 

19  bank  to  read  print.    See,  for  instance,  an  article  by 

20  Daniel  Goleman  in  the  May  12,  1985,  New  York  Times 

21  Magazine  on  experiments  in  which  words  were  read  by  either 

22  one  or  the  other  side  of  the  brain.      Again,  it  should  be 

23  possible  to  arrange  tests  between  two  groups,  sixth 

24  graders  phonically  trained  in  first  grade,  and  sixth 

25  graders  with  context-guessing  phony  phonics  plus  sight 
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1  words  in  first  grade. 

2  The  left  side  of  the  brain  is  normally  the 

3  language  side,  so  phonically  trained  sixth  graders  should 

4  test  like  the  classical  aphasic  patients  in  William  James' 

5  1980  psychology  ; text ,  "Capable  of  Reading  only  with  the 

6  Left  Side  of  the  Brain."    This  should  suggest  true 

7  dominance  and  the  formation  of  an  automatic  conditioned 

8  reflex. 

9  The  right  side  of  the  brain  is  known  to  be  used 

10  for  reading  of  Chinese  characters.    Since  sight  words  are 

11  taught  as  wholes  or  globally  like  Chinese  characters ,  and 

12  since  context-guessing  phony  phonics  teaches  partial 

13  phonics,  children  taught  with  these  two  associated 

14  approaches  should  demonstrate  they  are  reading  with  both 

15  sides  of  the  brain.    Reading  with  both  sides  of  the  brain 

16  suggests  mixed  dominance  with  possible  impairment  of 

17  automaticitVc 

18  Please  inform  me  if  you  will  or  will  not  request 

19  these  four  tests,  and,  if  not,  why  not,  so  that  your 

20  response  will  become  a  matter  of  public  record.  Thank 

21  you. 

22  MR.  STALFORD:     Thank  you.     It  is  not  our  position 

23  here  this  morning  to  answer  questions  about  what  we're 

24  going  to  do  in  the  recompetition. 

25  MS.  RODGERS:     I  don't  mean  now.     I  mean  at  the 

ERLC 


31 


1  time  of  the  tests,  you  know. 

2  MR,  STALFORD:    We  will  consider  your  views 

3  seriously.    Pamela  Buckley,  Co-Director  at  the 

4  Commonwealth  Center  for  the  Education  of  Teachers  at  James 

5  Madison  University. 

6  MS.  BUCKLEY:    Good  morning.     I'm  Co-Director  of 

7  the  Commonwealth  Center  for  the  Education  of  Teachers; 

8  which  is  an  unusual  function  because  we  function  as  a 

9  joint  project  between  two  universities,  James  Madison 

10  University  and  the  University  of  Virginia.    Our  purpose  is 

11  to  enhance  teacher  preparation  in  the  state  of  Virginia, 

12  the  Commonwealth  of  Virginia.    I  work  with  t.  e  37 

13  state-approved  Teacher  Education  Programs  in  the 

14  Commonwealth,  and  I'm  here  to  sp    k  today  as  a  member  of 

15  the  Appalachia  Educational  Laboratory  Board  of  Directors. 

16  Shortly  at;er  I  came  to  the  Commonwealth  Center 

17  last  July,  I  was  asked  to  represent  the  Virginia 

18  Association  of  Colleges  for  Teacher  Education  on  the 

19  Appalachia  Board  of  Directors,  and  I  have  been  very  active 

20  in  the  workshops  and  the  research  activities  in  the  state 

21  of  Virginia  connected  to  AE7      And  I  would  like  very  much 

22  to  support  the  activities  and  v  commend  that  they 

23  continue. 

24  The  AEL  Board  of  Directors  is  very  interesting 

25  because  it  is  a  microcosm  of  all  of  the  different 
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1  educational  groups  in  the  Commonwealth  and  in  the  region. 

2  We  represent  the  region  of  Tennessee,  Virginia,  West 

3  Virginia,  and  Kentucky.    Each  of  the  states  has  seven 

4  Board  members.    The  Board  members  include  the  Chief  Scate 

5  School  Officer,  a  representative  from  the  State  Education 

6  Association,  a  representative  from  the  State  School 

7  Administration  Association,  a  representative  from  the 

8  state's  Professional  Preparation  Program,  and  there  are 

9  three  elected  members  who  are  at-large  representatives. 

10  The  ^oard  serves  'xs  a  corporate  governing  body  but  it  is 

11  also  unusual  in  that  it  participates  in  activities 

12  sponsored  by  the  Lab* 

13  We  participate  in  state  board  groups  called 

14  Caucuses.    As  the  elected  leader  of  the  Virginia  State 

15  Caucus,  I  will  be  conducting  a  meeting  the  weekend  in 

16  conjunction  of  the  Board  of  Director's  meeting.    One  of 

17  the  things  that  we  will  be  doing  is  looking  at  a  statement 

18  reported  in  1985  on  the  status  quo  of  education  in 

19  Virginia,  and  we  will  be  updating  that  from  the  different 

20  perspectives  of  the  educational  groups. 

21  We  also  serve  as  members  of  the  Regional  Lab's 

22  Project  Advisory  Committe,  and  I  work  with  the 

23  Professional  Preparation  and  Research  Committee  which 

24  directs  a  study  grouo  in  Virginia.    Ea  h  of  the  states  in 

25  the  region  has  an  advisory  group  \nich  focuses  on  some 


33 


1  aspect  of  research.    The  Professional  Research  Group  in 

2  Virginia  is  focusing  on  at-risk  students  right  now.  One 

3  of  the  activities  that  they  are  in  the  process  of  doing  is 

4  developing  training  modules  to  prepare  student  teachers  to 

5  work  with  at-risk  students.  We  are  hoping  thesa  modules 

6  will  be  ready  at  the  end  of  this  year  and  anticipate  that 

7  they  will  be  taken  over  and  pilot-tested  by  all  four 

8  states  who  participate  in  AEL's  region, 

9  Our  region  is  very  grateful  to  AEL  because  it 

10  serves  as  a  vehicle  for  bringing  all  of  the  major  interest 

11  groups  in  education,  and  it  involves  all  of  the  members 

12  in  a  carefully  coordinated  agenda  of  research,  development 

13  and  training,  and  technical  assistance  activities  which 

14  impact  the  region. 

15  AEL's  research  and  development  activities  have 

16  direct  application  to  school  improvement.    In  my  own 

17  experience  with  the  Virginia  Association  of  Colleges  for 

18  Teacher  Education,  our  participants,  of  course,  are 

19  developing  preservice  training  modules  to  help  at-risk 

20  students.    A  Virginia  study  group,  in  preparing  these 

21  modules,  conducted  a  literature  review.     They  surveyed  all 

22  37  of  the  Teac"  ar  Preparation  Institutions  in  the 

23  Commonwealth.    They  surveyed  practitioners,  and  now  they 

24  are  putting  together  the  training  modules,  which,  as  I 

25  mentioned,  should  be  ready  by  the  end  of  this  year. 
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1  There  are  two  other  AEL  programs  which  sponsor 

2  study  groups,  and  that  is  the  Classroom  Instruction 

3  Program  and  the  School  Governance  and  Administration 

4  Program  and  is  one  example  of  a  major  impact.    One  of  the 

5  states  had  set  up  a  regulation  to  try  to  increase  the 

6  amount  of  reading  instruction  in  primary  grades,  and  as  a 

7  result  of  the  study  groups  looking  into  this  action,  they 

8  determined  that  the  regulation  would  actually  have  the 

9  opposite  affect,  that  it  would  decrease  the  amount  of  time 
spent  in  primary  reading  instruction.    So  the  state 

11  regulation  was  withdrawn. 

12  There  has  been  a  lot  of  training  with  the 

13  Classroom  Instruction  Program  and  the  State  Governance 

14  Program  since  1986.    Sixteen  packages  for 

15  Trair '^-the-Trainer  modules  have  been  developed,  and  AEL 

16  has  w  ^xaborated  with  the  State  Professional  Association 

17  to  provide  these  Training-the-Trainer  Programs  throughout 

18  the  legion.    Virginia  has  had  12  professional  association 

19  organizations  involved  in  selecting  and  putting  on  these 

20  Training-the-Trainer  workshop  packages.     It  has  been  a 

21  very  cost-effective  method  of  preparing  trainers  who  can 

22  work  around  the  state. 

23  The  State  Governance  and  Administration  Program 

24  has  collaborated  with  Virginia's  LEAD  project  in  the  last 
series  of  statewide  training  events  via  satellite.  So 
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1  we've  had  a  major  impact  there  in  reaching  a  lot  of 

2  groups . 

3  The  State  Governance  and  Administration 

4  Group  has  also  collaborated  with  the  Kentucky  LEAD  project 

5  to  obtain  a  grant  to  develop  Targets-f or-Trainers.  Last 

6  month  in  Charleston,  West  Virginia,  they  held  the  first 

7  Targets-for-Trainers  event  which  was  to  prepare 

8  instructional  leaders  in  the  region  to  train  other 

9  trainers.    I  understand  that  this  training  package  will  be 

10  offered  in  other  regions  later  on  in  the  year. 

11  Also  at  that  time  in  Charleston,  when  we  had  the 

12  Targets-f or-Trainers  Project,  we  also  had  Potpourri  ' 89 # 

13  which  was  a  showcase  of  Training-the-Trainer  modules,  and 

14  there  were  16  different  packages  which  were  presented  to 

15  educational  leaders  throughout  the  region  for  selection  by 

16  state  organizations  at  a  later  point  to  be  put  on. 

17  Other  training  efforts  of  AEL  include  a  Regional 

18  Liaison  Center  for  Urban  Educators,  and  the  Rural,  Small 

19  Schools  Program  which  is  now  in  the  development  stage.  It 

20  i£i  focusing  on  providing  on-site  technical  assistance. 

21  In  terms  of  technical  assistance,  most  of  the 

22  region  which  is  served  by  AEL  is  characterized  by 

23  isolation  in  rural  areas  and  poverty.    Most  of  the  schools 

24  in  the  region  we  found  out  were  using  help  from  three 

25  sources.    They  were  having  to  use  Appalachia  Educational 
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1  Laboratory,  they  were  coming  to  local  colleges  and 

2  universities,  and  they  were  looking  to  the  State 

3  Department  of  Education  for  technical  assistance. 

4  AEL  has  worked  out  a  number  of  long-distance 

5  strategies  to  assist  in  technical  assistance,  and  one  of 

6  the  major  areas  whirl*  they  have  offered  is  a  School 

7  Services  Center  which  lends  reference  materials,  which 

8  provides  instructional  packages,  and  which  offers  advice 

9  to  school  practitioners.    There  is  a  toll-free  number 

10  which  any  educator  in  the  region  can  call  the  number  and 

11  borrow  the  material  or  receive  advice  on  it. 

12  AEL  also  has  a  Regioanl  Liaison  Center  which 

13  works  with  nonadvantaged  people  who  reside  in  urban  areas. 

14  The  focus  with  the  Liaison  Center  is  to  help  parents  help 

15  their  children.     In  the  Rural,  Small  Schools  Program,  the 

16  focus  is  on  working  to  implement  a  School -Community 

17  Improvement  Process.    Basically  there  are  four  rural 

18  demonstration  sites,  at  which  25  percent  of  the  residents 

19  live  in  poverty. 

20  So  the  staff  is  working  to  develop  a  cadre  of 

21  school  community  leaders  and  help  plan  and  implement  a 

22  change.    During  the  first  year  in  Virginia,  for  example, 

23  the  community  passed  a  school  bond  issue  to  build  a  new 

24  school.    This  was  the  first  time  a  community  had  been  able 

25  to  pass  the  bond  issue  in  years. 
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1  Another  activity  which  the  AEL  provides  is  a 

2  newsletter  which  is  called,  "The  Link."    It  is  sent  out  to 

3  8,000  people,  and  through  surveys  we've  determined  that 

4  approximately  eight  to  ten  educators  as  colleagues  share 

5  it  with  one  another* 

6  There  are  many  examples  of  how  AEL's  projects  and 

7  strategies  have  made  the  Lab  an  integral  part  of  our 

8  Region's  educational  infrastructure.    For  example, 

9  the  Policy  and  Planning  Center's  1986  symposium  on 

10  technology  has  led  to  a  whole  array  of  new  state  and 

11  interstate  initiatives  now  being  documented  in  a 

12  tracer-case  study  by  the  Lab's  third-party  evaluator. 

13  Also  AEL's  Minigrants  Competition  has  instituted 

14  and  stimulated  a  lot  of  institutional  research  and 

15  development. 

16  In  conclusion  I  would  like  to  stress  one  final 

17  point,  and  that  is  the  importance  of  long-term  stability 

18  to  a  Regional  Laboratory.    And  AEL  has  served  our  area 

19  since  1966.     It  continues  to  provide  a  lot  of  long-term 

20  effects  which  have  made  a  major  impact  on  our  instruction 

21  in  four  different  regions  and  has  lead  to  a  tremendous 

22  increase  in  school  improvement,  and  it  has  motivated  a  lot 

23  of  collaboration  amongst  different  regions  and  educational 

24  groups. 

25  I'd  like  to  thank  you  all  very  much  for  giving  us 
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1  an  opportunity  to  make  comments  today. 

2  MR.  STALFORD:    As  I  mentioned  before,  two  people 

3  who  were  scheduled  to  speak  this  morning  have  called  in 

4  ill.    Judy  Conrad,  representing  the  Council  for 

5  Exceptional  Children  was  to  speak,  and  she  has  indicated 

6  she  will  mail  in  her  statement.    And  at  eleven  o'clock, 

7  Myrna  Cooper,  who  is  Director  of  the  New  York  City 

8  Teachers  Center  is  scheduled  to  speak,  and  she  has  called 

9  in  ill.    We  had  thought  earlier  in  the  morning  that  she 

10  would  facsimile  her  testimony  to  us.     But  apparently,  as 

11  of  a  minute  ago,  it  has  not  been  recieved,  and  we  are  not 

12  able  to  say  when  that  might  be  received. 

13  So  our  next  scheduled  speaker,  that  is  the  person 

14  who  has  called  in  advance  and  requested  to  speak,  is 

15  Thomas  Schultz  from  the  National  Association  of  State 

16  Boards  of  Education.    We  have  made  this  opportunity 

17  available  publicly  throughout  the  day  from  9:00  to  12:00 

18  md  from  1:00  to  4:00  p.m.    Tom  asked  to  speak  at  1:20,  so 

19  we  will  listen  to  his  statement  at  that  time. 

20  There  are  no  other  scheduled  speakers  at  this 

21  moment.    May  I  ask  if  there  is  anyone  here  who  did  not 

22  request  to  speak  in  advance,  but  who  is  here  and  would 

23  like  to  make  a  statement  this  morning?    If  not,  what  we 

24  will  do  is  recess.    I  believe  that  is  the  appropriate  term 

25  at  thir,  meeting.    We  will  maintain  a  staff  presence  here 
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1  and  a  reporter,  and  if  someone  comes  in,  we  will  listen  to 

2  their  statement.    Mr.  Schultz  will  be  here  at  1:20  this 

3  afternoon.    Thank  you. 

4  (Whereupon ,  at  10:20,  a  recess  was  taken  to 

5  reconvene  at  1:10  p.m.) 

6  MR.  STALFORD:    My  name  is  Charles  Stalford.  At 

7  1:10  p.m.  we  arc  going  to  reconvene  this  meeting.    I  have 

8  a  statement  by  Myrna  Cooper,  Director  of  the  New  York  City 

9  Teacher  Centers  Consortium,  which  she  had  planned  to 

10  present  at  this  meeting  today.    However,  illness  prevented 

11  her  from  coming.    She  has  sent  the  statement  by  facsimile. 

12  I  have  it,  and  I'm  going  to  have  it  read  into  the  record 

13  at  this  time. 

14  New  York  City  Teacher  Centers  Consortium. 

15  Statement  presented  by  Myrna  Cooper,  New  York  City  Teacher 

16  Centers  Consortium.    Before  an  open  meeting  on  the 

17  recompetition  of  Regional  Educational  Laboratories.  July 

18  19,  1989,  Washington  D.C. 

19  I'm  Myrna  Cooper,  Director  of  the  New  York  City 

20  Teacher  Centers  Consortium.    The  Consortium  is  a 

21  collaborative  effort  of  the  United  Federation  of  Teachers, 

22  the  New  York  City  Board  of  Education,  participating 

23  community  school  districts,  and  area  institutions  of 

24  higher  education.    Our  mission  is  to  serve  and  support 

25  teachers  as  they  seek  to  achieve  educational  improvements 
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1  for  students.    Each  year  we  serve  tens  of  thousands  of 

2  teachers  as  they  meet  the  needs  of  New  York  City's  nearly 

3  one  million  students.    The  Regional  Laboratory  for 

4  Educational  Improvements  of  the  Northeast  and  Islands 

5  (Northeast/Islands  Laboratory)  plays  an  essential  role  in 

6  our  work,  particularly  through  our  Restructuring  Schools 

7  Program. 

8  My  testimony  today  will  come  primarily  from  the 

9  perspective  of  a  user  of  laboratory  services.    I  also 

10  consider  the  mission  and  work  of  the  Lab  to  be  so 

11  important  that  it  is  worth  an  investment  of  my  own  time. 

12  I  therefore  serve  as  a  member  of  the  governing  Board  of 

13  the  Overseers  and  Executive  Committee  of  the 

14  Northeast/Islands  Laboratory.    Until  recently,  I  also 

15  served  on  the  Board  of  one  of  OERI's  R&D  Centers,  the 

16  Center  for  Teacher  Education. 

17  I  come  before  you,  then,  as  an  educator  and 

18  service  provider  with  working  knowledge  and  experience  of 

19  the  services,  operation,  and  governance  of  at  least  one 

20  Laboratory  —  the  one  serving  the  Northeast,  Puerto  Rico, 

21  and  the  Virgin  Islands  —  and  of  the  overall  research  and 

22  development  system  funded  by  OERI. 

23  I'm  pleased  to  have  the  opportunity  to  share  my 

24  ideas  with  OERI  about  the  Regional  Educational  Laboratory 

25  Program  in  this  public  hearing. 
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1  Although  I  have  had  prior  experience  with  a 

2  number  of  Laboratories  across  the  country,  my  immediate 

3  experience  —  and  what  I'll  speak  to  today  —  is  with  the 

4  Regional  laboratory  for  Educational  Improvement  of  the 

5  Northeast  and  Islands.    The  Northeast/Islands  Laboratory 

6  serves  New  York,  New  England,  Puerto  Rico,  and  the  Virgin 

7  Islands.    The  region  covers  nearly  120,000  square  miles, 

8  spans  a  distance  of  over  2,000  miles  from  the  northern 

9  Maine  to  the  Virgin  Islands,  and  includes  over  33  million 

10  people,  of  whom  nearly  six  million  are  of  school  age. 

11  Unlike  many  of  the  other  Laboratories  acivss  the 

12  country,  the  Northeast  Islands  Laboratory  is  still  in  its 

13  infancy,  having  first  been  funded  during  the  1985  OERI 

14  Laboratory  Competition.    Until  that  time,  our  region  was 

15  under-served  by  a  laboratory.    The  last  "laboratory-like" 

16  institution  that  served  *ny  significant  portion  of  the 

17  current  region  prior  to  the  Northeast/Islands  Laboratory 

18  was  the  Center  for  Urban  Education  in  New  York  Cit>,  which 

19  closed  in  1973.    For  organizations  such  as  mine,  and  for 

20  the  teachers  we  serve,  and  in  turn  the  students  they 

21  teach,  this  gap  in  school  improvement  and  R&D  services 

22  was  a  significant  problem.    Happily,  I'm  here  today  to 

23  report  that  with  the  funding  of  the  Northeast/Islands 

24  Regional  Laboratory  the  situation  has  changed  and  we  are 

25  now  able  to  take  advantage  of  high  quality  Lab  services, 
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1  which  are  already  beginning  to  make  a  difference 

2  throughout  the  region. 

3  I  have  watched  with  great  satisfaction  the 

4  development  of  a  vital  new  education  resource  in  the 

5  region.    In  an  amazingly  short  period  of  time,  three  and 

6  one-half  years,  we  have  gone  from  having  no  Lab  to  having 

7  a  sexvice  organization  that  provides  us  wit\  one  of  the 

8  best  sources  of  high  quality  R&D  assistance  across  the 

9  entire  country.    As  a  Board  member,  I  say  this  with  pride 

10  because  I  had  a  hand  in  ensuring  that  the  Lab  rapidly  rose 

11  to  meet  the  challenges  of  the  region.    But  as  a  client  I 

12  say  this  with  even  more  sincerity  and  pressure  because  it 

13  is  as  a  user  that  I  truly  experience  the  fruits  of  the 

14  Laboratbry  and  know  what  a  difference  it  can  make  in 

15  helping  schools  ensure  that  the  students  of  today  can  meet 

16  the  challenges  of  tomorrow. 

17  The  addition  of  the  Northeast/Islands  Laboratory 

18  to  the  region  has  radically  changed  access  educators  have 

19  to  research  and  technical  assistance.    Over  time,  the 

20  Northeast,  often  thought  of  as  resource  rich,  has  seen  a 
21'  decline  in  sources  of  such  assistance.    We  are  a  region 

22  rich  in  institutions  that  conduct  high-quality,  basic 

23  research.    But  as  a  service  organization,  the  Consortium 

24  needs  to  be  able  to  find  support  and  assistance  *"v.at 

25  reflects  an  understanding  of  our  day-to-day  realities  and 
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1  aimed  at  a  more  practice-oriented  level.    We  have  found 

2  such  support  from  the  Northeast/Islands  Laboratory  and  in 

3  filling  this  void  within  the  region,  the  Laboratory  has 

4  already  made  a  real  difference. 

5  Our  Consort ium,  in  partnership  with  the  United 

6  Federation  of  Teachers ,  is  designing  the  first 

7  teacher-initiated  restructuring  initiative  in  the  nation. 

8  It  is  with  this  effort  that  the  assistance  of  the 

9  Laboratory  has  been  truly  invaluable ,  although  we  have 

10  benefited  from  the  Labs'  work  through  a  wide  range  of 

11  other  activities  as  well. 

12  Teachers  are  key  to  the  transformation  of  schools 

13  into  learning  communities.     They  must  model  leadership  in 

14  active  learning  if  we  expect  youngsters  to  be  active 

15  learners.    They  must  take  a  major  role  in  restructuring 

16  curriculum  and  instruction  and  in  rethinking  school 

17  organization  and  procedures.    To  do  so  requires  that 

18  teachers  —  and  administrators  —  develop  new  skills, 

19  engage  in  new  activities,  and  assume  new  roles.     This  is 

20  an  enormous  challenge;  one  that  we  could  not  have  faced 

21  without  the  assistance  of  the  Northeast/Islands 

22  Laboratory. 

23  Given  the  limitations  of  time,  I  will  not  provide 

24  you  with  an  extensive  description  of  all  the  benefits  we 

25  have  received  from  the  collaborating  with  the  Lab. 
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1  However,  let  me  highlight  a  few  to  give  you  a  picture  of 

2  our  experience. 

3  The  Laboratory  first  and  foremost  provides  us 

4  with  ready  access  to  the  latest  and  best  available 

5  research  and  development  from  across  the  country,  and  in 

6  many  instances,  from  abroad  as  well.    Educators  are, 

7  unfortunately,  notorious  about  their  limited  use  of  R  &  D, 

8  often  because  it  is  not  easily  accessible  nor  is  it 

9  generally  understandable,  relevant,  or  usable  when  it  is 

10  available.    The  Lab  has  radically  changed  this  situation 

11  for  the  Consortium.    With  staff  who  understand  the  needs 

12  of  our  teachers  and  who  can  readily  step  back  and  forth 

13  from  the  research  world  to  the  world  of  practice,  the  Lab 

14  has  made  the  use  of  research  a  common  component  of  our 

15  work,  valued  by  our  teachers.    This  is  invaluable  to  the 

16  success  of  the  Consortium's  efforts.    With  dollars  in  such 

17  short  supply,  we  cannot  afford  to  duplicate  the  costiy 

18  mistakes  of  the  past,  nor  can  we  afford  to  overlook  what 

19  is  already  known  about  what  works, 

20  One  excellent  example  of  the  Labs'  efforts  in 

21  this  area  is  their  monthly  publication,  "The  Cutting 

22  Edge."    It  provides  digestible  abstracts  of  the  latest  R  & 

23  D  from  across  the  country  in  an  easy-to-read  form.  This 

24  publication  not  only  provides  the  Consortium  with  easy 

25  access  to  research,  v ut  also  encourages  us  to  reprint  the 
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1  information  and  share  it  with      .Aers  —  through 

2  newsletters,  papers,  letters,  routine  mailings  —  and  we 

3  do.    As  a  Board  member  of  the  Lab,  I'm  aware  of  the 

4  positive  evaluations  the  Lab  receives  on  this  publication 

5  and  that  the  typical  reader  passes  along  information  from 

6  it  to  an  average  of  12  other  colleagues  —  a  real  tribute 

7  to  its  worth. 

8  Related  to  this  service    che  Lab  serves  as  our 

9  way  of  plugging  into  the  larger  R&D  network  across  the 

10  country.    Rather  than  calling  each  OERI-funded  R&D 

11  Center,  for  example,  we  need  only  contact  the  Lab,  This 

12  gives  us  ready  access  not  only  to  the  resources  located  on 

13  the  Lab  premises,  but  to  those  throughout  the  entire 

14  network.    Staff  are  knowledgeable  about  the  work  of  their 

15  colleagues  and  have  always  been  eager  to  respond  to  our 

16  requests  for  additional  information,  materials,  and 

17  referrals  to  other  experts.    Access  to  this  type  of 

18  expertise  and  "connectedness"  to  the  R&D  world  has 

19  provided  critical  to  us,  particularly  as  we  have  pursued  a 

20  task  as  enourmous  and  overwhelming  as  restructuring  the 

21  New  York  City  Public  Schools. 

22  Access  to  this  network  also  allows  the  Lab  to 

23  anticipate  what  issues  and  problems  lie  ahead  for  us  and 

24  to  help  us  avoid,  or  at  least  prepare,  for  them.  Having 
2r>  access  to  an  organization  that  is  always  forward  looking, 
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1  and  that  can  place  what  they  are  seeing  within  the  context 

2  of  available  research  is  a  real  asset  to  us  and  to  the 

3  rest  of  the  region, 

4  The  Labs'  role  is  not  simply  to  provide  us  with 

5  access  to  R  &  D,  however.     Staff  serve  as  active 

6  translators  of  this  information  so  that  our  teachers  can 

7  actually  apply  it  tc  their  efforts.    Sometimes  this 

8  requires  synthesizing  the  information  that  is  available; 

9  other  times  it  has  resulted  in  developing  new  materials  or 

10  more  practice-oriented  tools;  and  at  other  times  it  has 

11  been  necessary  to  provide  direct  consultations  or 

12  workshops  to  demonstrate  why  the  research  actually  makes  a 

13  difference.    Researchers  often  corget  that  teachers  are 

14  oriented  toward  "doing."    Reflecting  on  what  they  are 

15  doing  and  why  and  how  it  relates  to  previous  research 

16  comes  late  in  the  process,  if  at  all. 

17  In  their  work  with  the  Consortium,  Lab  staff  have 

18  been  sensitive  to  the  realities  of  schooling  and  have 

19  developed  effective  strategies  to  help  our  teachers  break 

20  this  pattern  by  translating  research  into  action-oriented 

21  materials  an*  tools  that  are  seen  as  facilitators  and 
2?  benefits  rather  than  interference  and  barriers. 

23  I  cannot  stress  strongly  enough  the  benefit  of  a 

24  Lab  that  uses  a  mix  of  strategies,  technical  assistance, 

25  research,  evaluation,  dissemination,  product  development, 
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1  in  approaching  the  kinds  of  complex  problems  we  are  facing 

2  in  the  Consortium.     It  has  been  invaluable  to  us  to  be 

3  able  to  draw  upon  this  expertise.    Egually  invaluable  is 

4  having  a  staff  that  bridges  the  gap  between  research  and 

5  practice,  staff  who  are  comfortable,  knowledgeable,  and 

6  credible  in  both  worlds.    Too  often  researchers  do  not 

7  value  or  even  understand  the  realities  confronting 

8  teachers;  unfortunately,  this  can  render  their  research 

9  superficial  and  appearingly  irrelvant  to  the  needs  of 

10  practitioners.    With  "translators"  who  can  glean  the 

11  wisdom  embedded  in  some  of  this  work,  we  are  much  further 

12  ahead  in  our  efforts  than  if  we  found  it  expedient  to 

13  continue  to  disregard  this  research. 

14  i  do  not  wish  to  dwell  too  heavily  on  this  aspect 

15  of  the  Lab  since  there  are  others  that  have  been  equally 

16  beneficial.    But  I  do  want  to  stress  the  importance  of  the 

17  character  of  the  Lab  in  this  respect.    From  my  long 

18  history  in  education,  I  have  found  no  other  institutions 
that  systematically  play  this  role  at  all  —  let  alone 
ones  that  play  it  so  well  and  with  such  benefits  to 


19 
20 


21  educators. 
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But  let  me  turn  to  another  aspect  of  the  Lab  that 

23  we  have  found  particularly  beneficial.    I  hesitate  to 

24  provide  testimony  that  focuses  on  "process,"  since  I  know 

25  from  experience  how  difficult  it  is  to  convey  the  benefits 


ERiC  bbx 


48 


1  of  process.    Tangibles  are  always  much  easier  to  grasp. 

2  But  I  feel  compelled  to  emphasize  the  important  role  the 

3  Lab  plays  in  convening  people  who  generally  do  not  come 

4  together  to  address  and  solve  shared  problems.  Even 

5  within  the  Consortium,  we  found  this  incredibly  useful. 

6  Lab  staff  provided  a  safe,  nurturing  environment  for 

7  discussing  difficult  issues  and  for  developing  shared 

8  solutions.    They  assisted  us  in  developing  the  necessary 

9  teacher  ownership  in  the  Consortium's  efforts  while 

10  simultaneously  also  providing  teachers  with  new  skills  and 

11  in  modeling  the  types  of  behaviors  they,  in  turn,  will 

12  need  to  use  in  their  schools  and  classrooms. 

13  Please  do  not  underestimate  the  importance  of 

14  this  process  until  you  have  experienced  it.  I 

15  continuously  hear  from  colleagues  from  across  the  region 

16  who  have  participated  in  these  cessions  that  they  are 

17  invaluable  and  that  particularly  in  instances  that  bridge 

18  constituents  or  state  lines,  only  a  neutral  organization 

19  such  as  the  Lab  can  provide  such  a  ?,safeM  environment. 

20  Few  people  will  take  risks  without  some  type  of  "safety 

21  net"  and  without  risk  takers,  our  educational  system  will 

22  never  improve  In  the  ways  that  are  necessary. 

23  In  addition  to  all  of  these  benefits,  Lab  staff 

24  have  provided  us  with  workshops,  they  have  planned  and  led 

25  retreats,    they  have  ensured  that  we  knew  about  relevant 
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1  conferences  and  activities  that  we  might  participate  in, 

2  they  have  developed  materials  and  papers,  they  have  helped 

3  us  identify  and  access  additional  resources,  they  have 

4  assisted  us  in  maintaining  our  enthusiasm  in  the  face  of 

5  mounting  challenges,  and  most  importantly,  they  have  been 

6  and  continue  to  be,  there  *o  engage  in  joint  problem 

7  solving  whenever  we  call.    Knowing  that  someone  with  a 

8  proven  track  record  is  available  to  talk  makes  an  enormous 

9  difference. 

10  A  few  examples  of  additional  Laboratory  work 

11  right  be  illustrative  of  ot?-sr  benefits  to  us  and  the 

12  region.  One  particularly  successful  effort  of  the  Lab  is 

13  1:he  assistance  they  have  provided  us  in  the  area  of  the 

14  discouraged  learner.    While  we  have  many  teachers  with 

15  ideas  about  how  to  motivate  these  particular  students,  we 

16  needed  help  in  conceptualizing  the  problem  we  were  facing 

17  and  we  needed  F~meone  knowledgeable  who  could  synthesize 

18  and  help  us  u  .derstand  and  apply  the  latest  research.  We 

19  found  this  in  the  Lab,  and  the  teachers  loved  It. 

20  Using  a  very  different  set  of  strategies,  the  Lab 

21  is  developing  a  shared  decision-making  model  as  part  of  a 

22  project  it  is  conducting  in  New  York  State.    The  Lab  is 

23  able  to  take  what  we  are  doing  in  the  Consortium  and  apply 

24  it  to  this  broader  development  effort.    One  of  the 

25  strengths  of  the  Lab  is  to  take  local,  discrete  activities 
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1  and  transport  them  to  other  groups  or  jurisdictions  with 

2  similar  needs  or  interests.    Lab  staff  have  the  capacity 

3  to  tailor  information  to  meet  unique  needs,  and  they  know 

4  who  in  the  region  is  experiencing  these  needs. 

5  An  additional  benefit  of  the  Lab  to  the  region, 

6  one  which  is  often  overlooked,  is  to  Board  members 

7  themselves  and,  in  turn,  to  their  constituents.    Given  the 

8  breadth  and  depth  of  Board  member  expertise  and 

9  experience,  Board  meetings  individually  and  col  -Mvely 

10  broaden  one's  perspective  in  a  wide  range  of  issu  ae 

11  kinds  of  exchanges  we  have  on  Lab  issues  are  enligh  .  ing 

12  and  help  create  a  more  global  view  of  educational  issues 

13  and  problems.    This  is  of  great  value  to  me  personally. 

14  But  it  is  equally  valuable  to  my  constituents  as  I  apply 

15  these  new  understandings  to  my  work. 

16  To  put  it  bluntly,  I  am  a  client  who  is  not  only 

17  satisfied  but  enthusiastic  about  the  Lab  in  my  region  and 

18  the  overall  Laboratory  concept.    There  are  no  other 

19  organizations  across  the  country,  at  least  none  that  I  am 

20  aware  of,  that  provide  the  range  of  services  that  Labs  do, 

21  that  share  a  common  school  improvement  mission  coupled 

22  with  an  emphasis  on  R  &  D,  and  that  so  successfully  bridge 

23  the  gap  between  research  and  practice.    I  know  that  the 

24  Northeast/Islands  Laboratory  can  make,  and  has  made,  a 

25  difference  in  the  quality  of  education  in  our  region. 
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1 

Often  this  is  a  "behind  the  scenes"  success  that  others 

2 

don't  see  unless  people  such  as  myself  come  forward  to 

3 

articulate  the  benefits  of  the  Lab  program. 

4 

But  what,  you  might  ask,  does  this  say  about  the 

5 

upcoming  Lab  competition?    Clearly,  as  an  advocate  of 

6 

Laboratories,  I  am  concerned  about  the  Labs  of  the  future. 

7 

My  interest  is  in  strengthening  those  characteristics  that 

8 

I  think  contribute  to  the  success  of  the  Labs.    Let  me 

9 

highlight  some  of  those  aspects. 

10 

Governing  Boards.    One  of  the  key  and  critical 

11 

features  of  Labs  is  that  they  have  independent, 

12 

representative  governing  Boards.    I  consider  both  the 

13 

independent  and  representative  nature  of  these  Boards  to 

14 

be  crucial.    To  be  effective,  Labs  cannot  be  governed  by 

15 

boards  that  have  other  allegiances.    They  must  be 

16 

independent  so  that  they  can  provide  a  neutral  forum  for 

17 

addressing  issues.    As  a  Board,  they  must  be  able  to 

18 

transcend  constituency,  organizational ,  and  state 

19 

boundaries,  unhampered  by  other  loyalties  and  demands. 

21 

This  is  a  tall  order  but  I  have  seen  it  work  exceedingly 

21 

well  in  the  Northeast/Islands  Laboratory. 

22 

I  also  want  to  stress  the  importance  of 

23 

representation  of  the  Boards  —  both  in  terms  of 

24 

constituents  and  jurisdictions.    As  we  in  education  move 

25 

forward  to  restructure  schools,  we  need  to  remember  that 
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1  one  of  the  essential  ingredients  of  the  success  of  these 

2  efforts  is  that  all  the  key  actors  are  involved.  The 

3  major  constituency  groups,  including  the  chief  state 

4  school  officers  and  representatives  of  teachers, 

5  administrators,  professional  associations,  higher 

6  education,  state  and  local  policy  makers,  business,  and 

7  others,  must  feel  that  they  have  a  role  to  play  in  the 

8  governance  of  the  Labs  if  they  are  to  develop  the  kind  of 

9  ownership  that  we  need  to  confront  the  problems  facing 

10  education. 

11  Mix  of  strategies.    To  be  effective,  Laboratories 

12  must  have  the  flexibility  to  use  a  range  of  strategies  to 

13  meet  the  needs  of  their  diverse  regions.    For  the 

14  Consortium,  it  has  been  essential  that  the  Lab  have 

15  expertise  in  a  broad  array  of  areas,  from  research  to 

16  evaluation  to  technical  assistance  to  product  development 

17  and  dissemination.    One-stop  shopping  is  a  major  asset  for 

18  educators  and  can  make  all  the  difference  between  using 

19  and  ignoring  available  resources.    Equallv  important  is 

20  the  ability  to  modify  the  mix  of  strategies  as  new  needs 

21  and  issues  emerge. 

22  One  of  the  characteristics  of  the 

23  Northeast/Islands  Laboratory  is  that  it  constantly  looks 

24  forward  and  anticipates  what  will  be  needed  while 

25  simultaneously  responding  to  the  immediate  needs  of 
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constituents.    This  requires  flexibility  in  both  the  what 
and  how  of  the  Lab.    I  would  strongly  urge  OERI  to 
maintain  this  flexibility  rather  than  imposing  specific 
strategies  and/or  content  areas.    To  be  responsive  to  the 
region  necessitates  such  flexibility. 

Stability.    Change  takes  time.     It  will  take  time 
for  us  to  restructure  the  New  York  City  Public  Schools 
even  partially.    It  takes  time  for  a  Laboratory  to  develop 
a  full  roster  of  services  and  products  and  to  develop  the 
necessary  trust  to  work  collaboratively  with  educators  and 
policy  makers  throughout  its  region.    I  would  hope  that 
OERI  recognizes  the  importance  of  stability  and 
continuity  —  in  terms  of  regions,  a  concept  I  soundly 
support  as  cost  effective  and  appropriate,  mission, 
structure,  etc.    Providing  stable  institutional  support  to 
the  Labs  is  a  sound  federal  investment. 

Again,  I  appreciate  the  opportunity  to  share 
these  thoughts  with  you  and  encourage  OERI  to  continue  to 
fully  support  the  excellent  work  of  the  Laboratory 
program. 

MR.  STALFORD:    Our  next  speaker  is  Mr.  Thomas 
Schultz  with  the  National  Association  of  State  Boards  of 
Education.    Welcome,  Tom. 

MP.  SCHULTZ:    Thank  you.     I'm  pleased  to  be  at  a 
non-invitational  meeting,  and  what  I  would  like  to  talk 
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1  about  is  the  potential  of  Regional  Laboratories  to  address 

2  these  areas  of  child  education. 

3  What  I'd  like  to  argue  briefly  about  is  that  the 

4  area  of  child  care  and  early  childhood  services  is  one 

5  where  Lab  services  would  be  appropriately  needed  to  talk 

6  about  some  types  of  issues  that  I  think  are  relevant  in 

7  terms  of  needs  of  public  school  clients,  and  then  talk 

8  briefly  about  some  possible  stategies  that  I  think  would 

9  be  appropriate  and  useful  for  Laboratories. 

10  I  think,  briefly,  the  market  or  the  need  for 

11  applied  R&D,  technical  assistance,  in  the  area  of  early 

12  childhood  is  based  on  growing  funding,  and  policy 

13  attention.    We  have  on  the  federal  level  a  continuation  of 

14  programs  through  Chapter  1,  Head  Start  which  are  often 

15  housed  in  public  schools.    But  in  recent  years  we've  had 

16  an  expansion  of  funding  to  address  the  needs  of  preschool 

17  children,  and  we  now  have  data  on  a  possible  child-care 

18  initiative. 

19  Along  with  the  federal  level,  we  have  over  30 

20  states  that  are  now  funding  a  variety  of  child-care, 

21  parent  education,  preschool  programs  offered  to  other 

22  schools,  and  also,  records  of  many  local  initiatives  to 

23  use  parent  fees  and  local  school  dollars  to  serve  younger 

24  kids. 

25  I  think  these  policy  and  funding  initiatives 


erJc  bo  j 


55 


1  reflect  a  variety  of  factors  of  needs  on  the  part  of 

2  families  and  children.    And  I'll  just  mention  three  of 

3  them  quickly. 

4  I  think  we  have  the  benefit  of  a  solid 

5  knowledge-base  on  the  benefits  of  high-quality,  early 

6  childhood  services,  particularlY  for  at-risk  kids.  I 

7  think  we  have  clear  evidence  of  the  trends  in  the  work 

8  force  participation  of  parents  that  support  a  need  to 

9  provide  child-care  for  smaller  children.     I  think  we  have 

10  qualities  of  a  strong  program  for  younger  children. 

11  So  I  think  we  have  both  a  need  and  a  kind  of 

12  knowledge-base  to  apply  to  planning  in  this  program. 

13  In  terms  of  talking  about  particular  issues  that 

14  I  would  see  as  needs  of  public  school  and  possible  areas 

15  for  activity  on  the  part  of  Laboratories,  I  would  hit  on 

16  three  various  things  of  initial  need  of  public  schools. 

17  The  first  is  guidance  in  the  planning  implementation  of 

18  these  programs  as  funding  comes  down  the  pike  or  as 

19  legislative  initiatives  are  being  crafted  at  the  state 

20  level.     I  think  that  Laboratories  and  other  agents  can 

21  provide  a  helpful  role  in  applying  the  knowledge  based  on 

22  what  constitutes  high-quality  services  so  that  we  have 

23  standards,  staff  development,  funding,  equipment, 

24  materials,  appropriate  attention  in  parent  involvement, 

25  and  a  sound  basis  in  terms  of  curriculum  as  schools  move 
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1  in  to  serve  new  kids. 

2  I  think  a  second  area  that  tends  to,  perhaps,  not 

3  be  defined  as  early  childhood  on  the  part  of  many  people, 

4  that  I  think  is  a  growing  concern  in  the  early  childhood 

5  profession,  is  looking  at  the  need  for  improved  assesment 

6  and  instruction  in  kindergarten  and  primary  grades.  I 

7  think  there  is  a  great  concern  on  the  part  of  parents  and 

8  early  childhood  educators  regarding  trends  to  increase  the 

9  use  of  readiness  tests  and  other  forms  of  assesment 

10  increasing  rates  of  retaining  children  in  kindergarten 

11  programs  or  extra-year  programs*    Accompanying  those 

12  problems  is  a 

13  sense  that  the  expectations  in  terms  of  academic 

14  instruction  in  kindergarten  are  leading  to  pressures  for 

15  kindergarten  teachers  to  adopt  a  form  or  method  of 

16  instruction  that  is  not  in  the  best  interest  of  young 

17  kids,  and  it  is  not,  in  the  long-run,  the  best  way  to 

18  promote  their  happines  and  growth. 

19  So  I  think  there  is  a  great  need  to  look  at  ways 

20  to  take  advantage  of  effective  programs  like  cooperative 

21  learning,  like  language  instruction,  reading  and  writing, 

22  hands-on  approaches  to  science  instruction,  and  find  ways 

23  to  make  the  early  experiences  that  kids  have  in  public 

24  schools  successful  and  intellectually  stimulating. 

25  I  think  this  is  very  much  a  part  of  my  view  of  the  agenda 
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1  of  early  childhood  education. 

2  The  third  area,  I'll  mention  quickly,  is  the  need 

3  to  help  schools  in  building  relationships  without 

4  community  agencies  that  serve  young  children.    I  think 

5  that  in  both  planning  and  mounting  new  programs,  we're 

6  finding  many  instances  of  competition  between  public 

7  schools  and  new  dollars  and  existing  Head-Start, 

8  for-profit,  church-based  programs  that  are  hiring  staff 

9  away  from  these  educational  programs.    I  think  there  is  a 

10  need  to  build  bridges  between  public  schools  and  agencies. 

11  I  think  another  argument  for  that  is  the  need  to  provide 

12  greater  continuity  for  children  and  parents  as  kids  move 

13  from  early  childhood  systems  into  the  public  schools. 

14  Continuity  is  an  issue  in  their  daily  routine,  if  they're 

15  involved  several  different  early  childhood  sessions. 

16  Let  me  move  to  some  examples  of  activities  I 

17  think  the  Regional  Labs  could  carry  out.    I  think  there 

18  has  been  a  great  investment  in  research  and  models  of 

19  technical  assistance.    I  think  what  we  need  is  essentially 

20  the  Labs  to  provide  support  on  a  kind  of  steady  sensible 

21  basis.     I  think  the  need  is  not  to  kind  of  invent  creative 

22  breakthroughs  or  to  invest  in  basic  research,  but  rather 

23  take  the  knowledge  that  we've  got  and  to  put  it  in  against 

24  the  people  who  are  making  decisions  in  the  program.  I'll 

25  give  three  quick  axamples  of  what  I  think  they  could  do. 
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1  First  I  think  they  could  serve  as  a  clearinghouse 

2  for  information  on  existing  programs  and  policies  in  their 

3  regions  across  the  country  so  that  people  are  aware  of  how 

4  other  states  and  other  localities  solve  problems  like 

5  funding,  staff  qualifications,  program  standards,  I 

6  think  a  second  in  the  category  of  possible  Lab  services 

7  would  be  to  provide  better  descriptive  studies  of 

8  innovative  programs  that  address  new  challenges  on  the 

9  early  childhood  services.      Some  examples  of  issues  like 

10  this  would  be  how  different  public  schools,  early 

11  childhood  programs,  put  together  staff  teams  that  blend 

12  people  with  different  types  of  training  responsibility  and 

13  compensation,  how  early  childhood  programs  address  the 

14  needs  of  multicultural  children  and  their  families,  how  we 

15  can  approve  assessment  of  young  children  coming  into  the 

16  public  schools. 

17  Finally  it  seems  to  me  that  Labs  could  provide 

18  some  process  help  in  the  area  particularly  of  planning  and 

19  collaboration  because  they  are  either  seen  as  neutral  or 

20  kind  of  mysterious  partners  in  the  present  enterprise 

21  based  on  their  structure  and  governance.    I  think  they 

22  could  help  bring  together  folks  at  the  state  level  that 

23  represent  different  agencies  or  different  interest  groups 

24  and  also  facilitate  that  kind  of  a  collaboration  at  the 

25  local  level. 
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1  It  seems  to  me  a  final  example  of  a  possible  Lab 

2  role  would  be  to  support  networks  of  people  in  similar 

3  roles  across  their  region  such  as  early  childhood 

4  specialists,  State  Department  of  Education  people  who 

5  manage  early  childhood  services  in  big  city  school 

6  districts,  and  people  who  deal  with  staff  development  for 

7  teachers  with  young  children. 

8  I'm  not  sure  what  to  suggest  in  particular 

9  regarding  adoption  of  this  as  a  priority  in  the  RFP  or 

10  whether  should  be  mandated  across  all  Labs.     But  it  seems 

11  to  me  it's  an  issue  that  ought  to  be  considered  by  Labs  as 

12  they  plan  and  consult  with  groups  in  their  region.  Thank 

13  you. 

14  MR.  STALFORD:    Tom,  I  had  mentioned  this  morning 

15  that  it  is  not  our  intention  to  engage  in  any  dialog  in 

16  the  forwat  of  this  meeting.     But  I  did  ask  one  question  to 

17  clarify  something,  and  if  I  could  ask  you?    You  mentioned 

18  the  Labs  being  a  mysterious  partner  in  this  enterprise. 

19  Can  you  elaborate  a  bit,  do  you  mean  an  enterprise  of 

20  early  childhood  education? 

21  MR.  SCHULTZ:    What  I  mean  is  that  I  think  as  the 

22  states  are  making  funding  decisions  about  early  childhood 

23  programs,  there  are  turf  battles  and  rivalries  between 

24  human  service  folks,  education  folks,  Head  Start  folks, 

25  and  I  think  while  Labs  are  clearly  mandated  to  serve  as  a 
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1  resource  to  the  public  education  system,  I  don't  think 

2  they  have  the  same  sense  of  self-interest  or 

3  identification  with  the  public  schools  as  other  agencies 

4  may, 

5  So  I  think  they  might  be  able  to  come  in  as  a 

6  neutral  third  party  or  as  a  party  that  is  not  invested 

7  particularly  in  the  outcomes  of  policy  debates  or 

8  decisions  at  a  local  level  and  bring  people  together,  or 

9  serve  as  a  facilitator  or  some  of  that  kind  of  process 

10  work. 

11  I  would  imaqine  that  most  people  in  their  early 

12  childhood  communities  are  not  familiar  with  the  Labs.  But 

13  I'm  not  saying  that  to  kind  of  denigrate  that  they  haven't 

14  made  necessary  efforts  in  the  past.     I  think  it's  a 

15  positive  to  me  that  they  could  help  to  bring  groups 

16  together  because  of  their  special  institutions. 

17  MR.  STALFORD:     They  have  an  interest  in  public 

18  schools,  public  education,  but  not  in  this  area  or  in  the 

19  education  of  the  early  childhood  area? 

20  MR.  SCHULTZ:     That  is  what  I  would  say. 

21  MR.  STALFORD:     Okay,  thank  you  very  much-  This 

22  meeting  is  open  formally  until  4:00  p.m.,  if  other  members 

23  of  the  public  wish  to  come  and  speak.    If  there  be  no 

24  members  at  the  moment,  we'll  recess. 

25  (Later,  at  4:00  p.m.,  the  meeting  was  concluded.) 
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FRIDAY,  JULY  21.  1989 

PROCEEDINGS 
 oOo  

MR.  JOHN  EGERMEIER:  Good  morning.  My  name  is  John 
Egermeier  of  OERI,  the  Office  of  Educational  Research  and 
improvement,  U.S.  Department  of  Education. 

This  is  one  of  three  open  meetings  at  which  the  public 
may  make  suggestions  to  OERI  about  the  future  of  the  Regional 
Educational  Laboratory  Program  in  connection  with  the 
forthcoming  recompetition  of  the  existing  awards  to  operate 
laboratories. 

A  fact  sheet  about  these  meetings  is  available  in  this 
room  plus  copies  of  the  notice  about  the  meetings  printed  in 
the  Federal  Register  on  June  23,  1989. 

The  purpose  of  these  meetings  is  to  extend  an 
opportunity  for  interested  groups  and  individuals  w  submit 
views  and  advice  on  educational  needs  and  priorities  and  on 
ways  that  the  regional  educational  laboratories  can  be  most 
responsive  to  those  needs. 

These  views  are  being  sought  by  OERI  to  assist 
planning  for  the  forthcoming  competition  of  existing  awards 
to  operate  the  laboratories. 

OERI  seeks  the  individual  views  of  the  presenter  for 
the  organizations  they  represent  at  these  meetings,  not  a 
consensus  of  the  participants. 
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As  indicated  in  the  Federal  Register  notice,  OERI  is 
especially  interested  in  seeking  views  and  advice  from  the 
public  on  the  following  issues: 

(1)  What  activities  conducted  by  the  regional 
educational  laboratories  have  been  most  valuable  in  the  past 
two  to  three  years? 

( 2 )  How  can  regional  laboratories  contribute  to 
improving  performance  of  our  educational  systems  —  that  is, 
what  are  the  key  issues  and  problems  they  should  address  in 
the  future? 

(3)  What  kinds  of  laboratory  activities  and 
strategies,  for  example,  syntheses  and  other  research  and 
development  products,  direct  technical  assistance,  training 
and  capacity  building,  et  cetera,  would  be  most  beneficial 
in  the  future? 

(4)  What  form  of  relationships  between  laboratories 
and  other  organizations  or  persons  seeking  improvement  in 
schools  would  be  most  effective? 

I  will  chair  the  meeting.  Persons  wishing  to  make  a 
statement  at  these  meetings  have  been  assigned  blocks  of 
time. 

I  request  that  each  presenter  identify  herself  or 
himself  and  if  appropriate  the  organization  or  group  they  are 
representing  before  making  their  statement. 

Pre  senters  are  also  asked  to  leave  a  copy  of  their 
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statement  with  me  before  leaving  the  meeting,  if  possible. 

A  verbatim  transcript  will  be  made  of  the 
presentations  at  this  meeting  and  also  presentations  that 
were  made  at  the  other  two  meetings  held  this  week.  The 
reporter  at  the  head  table  here  is  present  for  this  prrpose. 

OERI  will  make  the  transcript  publically  available  to 
anyone  interested  in  the  recompetition.  Other  papers  and 
reports  related  to  the  recompetition  are  also  available  to 
the  public.  An  order  form  for  these  documents  is  in  the  room 
for  those  who  are  interested. 

Persons  in  attendance  but  not  presenting  today  plus 
others  in  the  public  may  also  submit  written  statements 
directly  to  OERI  on  the  issues  previously  stated. 

Such  statements  should  be  sent  to  OERI  at  the  address 
in  the  fact  sheet  and  be  mailed  by  July  24  if  you  are 
attending  today  and  wish  to  make  a  statement  based  on 
presentations  you've  heard  at  this  meeting. 

Are  there  any  questions  about  today's  meeting  on  the 

record? 

If  there  are  no  further  questions  we  will  proceed, 
And  our  first  speaker  will  be  Ms.  Sherlyn  Franklin. 

PRESENTATION 
BY  MS.  SHERLYN  FRANKLIN: 

Aloha   and  good  morning .      I   am  Sherlyn  Franklin , 
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Assistant  to  the  President  of  the  Kamehameha  Schools,  Bernice 
Pauahi  Bishop  Estate  and  located  in  Honolulu,  Hawaii.  Since 
1887  we  have  provided  educational  services  to  native 
Hawaiians • 

Thank  you  for  this  opportunity  to  share  a  few  thoughts 
regarding  educational  laboratories  in  general,  the  Pacific 
Laboratory  in  particular,  and  the  intended  recompetition  for 
educational  laboratories  in  1990. 

As  a  professional  at  the  Kamehameha  Schools,  as  a 
Pacific  Islander,  and  as  a  person  of  Hawaiian  ancestry,  I 
wish  to  underscore  the  inherent  need  for  and  value  of 
educational  laboratories,  particularly  in  the  changing  and 
developing  Pacific  basin.  With  your  indulgence,  I  would  like 
to  briefly  elaborate. 

I  am  pleased  that  a  tenth  region  is  being  added  to 
serve  the  geographic  region  encompassing  the  Pacific  basin. 
It  is  critical  that  there  be  a  comprehensive,  functional 
educational  laboratory  serving  its  needs. 

The  Northwest  Regional  Educational  Laboratory  over  the 
past  four  years  has  ably  fulfilled  its  charge  and  it's 
commitment  to  develop  a  Pacific  lab.  In  place  is  an 
impressive  regional  agenda  setting  mechanism. 

This  was  accomplished  through  the  Northwest  Center  for 
the  Advancement  of  Pacific  Education  referred  to  as  "CAPE. " 

In  turn,  CAPE  clearly  demonstrates  characteristics  of 
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a  viable  educational  laboratory ,  speaking  well  to  the  future 
success  of  a  Pacific  laboratory  and  to  the  questions  raised 
in  the  Federal  Register  announcement  for  this  meeting- 

The  first  characteristic  is  a  regional  agenda  setting 
body,  the  CAPE  Program  Policy  Board  consisting  of  the  key 
Pacific  educational  leaders  and  policy  makers. 

This  laboratory  activity  has  been  extremely 
successful.  Issues  of  ownership,  responsiveness,  and 
relevance  have  been  ensured  through  this  important  body,  and 
I  urge  the  regional  agency  setting  mechanism  to  be  continued 
in  the  next  cycle  of  regional  laboratories. 

Second,  training  and  technical  assistance  functions 
have  developed  well  beyond  all  expectation.  Through  school 
local  —  excuse  me  —  through  local  school  improvement  teams, 
training  and  technical  assistance  have  focused  on  priorities 
established  in  response  to  local  needs.  A  "working  withH 
rather  than  Mdoing  forH  approach  has  paid  enormous  dividends. 

Issues  of  continuing  focus,  local  relevance, 
ownership,  potential  impact,  and  long-term  results  have  been 
admirably  addressed  through  a  "trainer  of  trainers'*  mode. 

While  training  trainers  is  a  popular  approach  to 
school  improvement,  all  too  often  the  people  trained  never 
conduct  any  training  themselves.  The  impact  is  obviously 
diluted,  if  not  lost  entirely. 

In  the  Pacific,  trainers  actually  train  their  peers 
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within  and  across  departments  of  education.  Independence 
from  outside  resources  is  nurtured  and,  in  turn,  releases 
laboratory  resources  for  further  work. 

This  approach  has  worked  well  in  the  Pacific  because 
of  the  commitment  of  educational  leaders  to  the  entire 
process  from  planning  to  implementation. 

Their  support  in  identifying  training  needs, 
appropriate  trainers  and  trainees,  and  subsequent  commitment 
to  systematic  implementation  has  made  this  approach  work. 

I  believe  this  thorough  and  systematic  approach  is 
important  to  future  laboratory  activities. 

And  third,  CAPE  has  engaged  a  regional  cadre  of 
qualified  Pacific  educators  to  conduct  applied  research  aimed 
at  locally  and  regionally  identified  school  improvement 
priorities . 

This  version  of  "with  and  through"  has  yielded  superb 
results  and  merits  consideration  for  regional  laboratories 
in  general. 

Strategies  that  foster  local  capacity  and  independence 
are  most  critical  to  regional  laboratories  and  their 
contribution  to  the  ongoing  improvement  of  education  and  our 
educational  system. 

This  is  particularly  true  given  the  increasing  demand 
by  communities  for  control  of  schools  and  of  the  education 
of  their  children. 
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The  characteristics  of  CAPE  mentioned  above  illustrate 
how  continuing  issues  in  American  education  are  addressed  in 
the  Pacific,  and  perhaps  these  characteristics  warrant 
consideration  for  the  other  nine  laboratories. 

Pacific  applied  research  activities  have  targeted 
three  essential  areas  thus  far:  (1)  improving  the 
information  base  in  this  large  geographic  area  from  which 
educational  leaders  make  decisions  through  two  documents,  A 
Profile  of  Pacific  Schools  and  A  Profile  of  Pacific  Higher 
Education;  (2)  sharing  successful  practices  through  a 
compendium  entitled  Promis  ing  Practices  for  Pac  if  ic 
Education:  and  (3)conducting  locally  based  research  through 
R&D  Cadre  members. 

The  result  of  these  R&D  activities  is  a  set  of 
products  that  are  extremely  functional,  making  connections 
with  ongoing  school  improvement  training  and  technical 
assistance  activities.  These  types  of  activities  will  be 
very  beneficial  in  the  future  as  well. 

Laboratory  relationships  with  other  organizations  and 
persons  clearly  need  to  be  based  upon  a  common  agenda;  ^ 
however,    diversity  of  perspective  must  be  ensured,  thus 
maintaining  a  dynamic  organization  responsive  to  OERI  as  well 
as  the  constituency  it  serves. 

The  laboratory's  governing  body  establishes  an 
important  and  primary  relationship  with  other  organizations 

&V-4 
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and  persons. 

Without  question,  however ,  as  the  primary  focus  is 
educational  improvement,  proper  representation  by  educators 
is  imperative. 

At  the  implementation  level ,  I  urge  a  broader 
relationship  that  targets  on  schools,  classrooms,  principals, 
and  teachers.  This  is  where  education  is  delivered  and,  in 
turn,  where  laboratories  must  have  the  greatest  impact. 

Also,  I  encourage  an  increased  emphasis  on  the 
involvement  of  parents  and  the  community.  These  persons  can 
effectively  facilitate  improvement  in  schools.  A  proactive 
stance  in  this  regard  is  both  warranted  and  needed. 

In  closing,  I  must  underscore  the  critical  need  for 
regional  educational  laboratories  and  the  valuable 
contribution  they  make  to  school  improvement.  In  the 
Pacific,  we  look  forward  to  our  laboratory  and  to  working 
with  the  national  network  of  labs. 

Thank  you  again  very  much  for  this  opportunity  to 
share  my  thoughts  with  you  this  morning. 

MR.  EGERMEIER:  Thank  you,  Sherlyn.  Dale  Lambert  will 
be  our  next  presenter. 

PRESENTATION 

BY  MR.  DALE  LAMBERT: 
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Dile  Lambert.  I'm  a  Social  Studies  High  School 
teacher  at  Eastmont  High  School  in  East  Wenatcheer 
Washington. 

It  is  my  personal  and  professional  privilege  to 
directly  participate  in  this  open  meeting  organized  and 
conducted  by  the  Office  of  Educational  Research  and 
Improvement  concerning  the  1990  recompetition  of  regional 
educational  laboratories . 

As  a  professional  educator  who  Las  been  actively 
involved  with  local ,  state ,  region*! ,  national ,  and 
international  aspects  of  education,  I  have  been  impressed  by 
the  excellent  quality  of  services  offered  by  the  nine 
regional  educational  laboratories  in  the  United  States. 

The  frequency  of  communications ,  the  diversity  of 
activities,  the  overwhelming  willingness  of  lab  personnel  to 
help  upon  request,  and  the  overall  effectiveness  of  technical 
assistance  and  professional  training  programs  reflect  this 
excellence. 

In  addition,  it  is  most  encouraging  and  gratifying  to 
realize  the  continued  ideological  and  financial  support  of 
the  regional  laboratories  by  the  Congress  of  the  United 
States,  the  Department  of  Education,  and  the  Office  of 
Educational  Research  and  Improvement . 

Since  1  have  had  only  occasional  and  limited 
experience  with  those  eight  regional  laboratories  outside  the 
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Pacific  Northwest,  I  shall  restrict  my  observations  to  the 
work  of  the  Northwest  Regional  Educational  Laboratory  located 
in  Portland,  Oregon. 

For  the  past  23  consecutive  years,  the  Northwest 
Regional  Educational  Laboratory  has  positively  impacted  the 
educational  systems  serving  the  residents  of  Alaska,  Hawaii, 
Idaho,  Montana,  Oregon,  and  Washington;  as  well  as  the  trusts 
and  territorial  possessions  of  the  United  States  in  the 
Pacific  Basin. 

Being  the  largest  geographic  region  and  the  most 
culturally  and  ethnically  diverse  of  the  nine,  the  Northwest 
Regional  Educational  Laboratory  has  understood  the  complexity 
of  its  task  and  performed  with  unusual  effectiveness. 

Extremely  high  quality  workmanship  and  professionalism 
over  this  extended  time  period  has  secured  their  reputation 
for  excellence,  a  well  deserved  national  acclaim,  and  mutual 
respect  by  its  colleagues.  The  Northwest  Regional 
Educational  Laboratory  has  evolved  as  an  outstanding  role 
model  for  other  labs  to  emulate. 

The  keys  to  the  Northwest  Regional  Educational 
Laboratory  's  sustained  success  are  its  stability,  the 
genuine  quality  of  its  staff,  and  the  effectiveness  of  its 
futuristic  leadership. 

This  lab  has  developed  programs,  established  policies, 
and  designed  processes  enabling  change  to  take  place  smoothly 
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and  efficiently  as  its  regional  needs  have  been  assessed, 
identified,  discussed,  evaluated  and  prioritized  by  its 
constituency.  The  Lab  implemented  these  changes  after 
thorough  study. 

During  the  past  three  years,  the  Northwest  Regional 
Educational  Laboratory  has  been  especially  active :      ( 1 ) 
providing  technical  assistance  in  response  to  requests  from 
individuals   or  organizations;    (2)    conducting  educational 
research;  (3)  publishing  new  education  related  products  for 
distribution  and  utilization  by  the  education  community;  (4) 
organizing,  sponsoring,  coordinating,  and  conducting  numerous 
workshops,  conferences,  and  inservice  training  sessions  to 
enhance  professional  development  and  improve  instruction;  (5) 
identifying  and  announcing  effective  practices  as  well  as 
exemplary  programs  and  individuals;  and  (6)  facilitating  and 
forming  new  partnerships  between  education  and  business, 
government  agencies ,   and  community  organizations ,  thereby 
improving  the  direct  lines  of  communication  between  educators 
and  the  public. 

Even  considering  the  aforementioned  activities,  there 
are  several  exemplary  activities  that  warrant  special 
attention . 

These  include:  (1)  the  elaborate  effort  by  the  Lab  in 
establishing  a  broad  based  input  system  for  its  annual  needs 
assessment  process   involving  direct  input  by  state-level 
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chief  school  officers  meetings,  state-level  school 
improvement  organization  meetings,  advisory  committee  input, 
needs  identification  requests,  client  follow-up  surveys,  and 
the  Northwest  Regional  Laboratory  Planning  and  Senior  Program 
staff. 

The  second  outstanding  activity  of  the  Lab  is  the 
Western  Center  for  Drag  Free  Schools  and  Communities,  a 
three-year  project  to  help  students  and  educators  address  the 
ramifications  of  drug  and  alcohol  abuse  in  our  society  and 
its  educational  systems. 

A  third  major  activity  is  a  Rural,  Small  Schools 
Initiative  which  provides  funding  for  meeting  the  unique 
needs  of  rural  areas.  New  and  existing  programs  have  been 
funded  resulting  in  the  identification  of  effective  programs 
and  the  identification  of  effective  practices  throughout  the 
region  such  as  its  distance  education  projects  and  a  program, 
"Successful  Schools , H  an  innovative  program  of  consensus 
building  by  involving  all  community  members  of  four  small, 
rural  schools. 

Fourth,  the  significant  commitment  by  the  Lab  and  its 
staff  to  meet  the  educational  challenges  of  youth  at  risk, 
or  disconnected  or  dysfunctional  youth  in  our  society. 

Our  educational  system  and  society  are  faced  with  many 
complex  issues  and  perplexing  problems.  The  Northwest  Staff 
annually   assesses    the   needs    of   the    region   via  several 
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different  input  mechanisms. 

After  careful  study  and  review,  the  most  clearly 
defined  trends  are  identified,  then  processes,  policies,  and 
programs  are  developed  to  meet  these  needs. 

The  following  represents  some  of  those  pressing  issues 
faced  by  the  educational  establishment  and  the  Northwest  Lab: 
(A)  forging  new  partnerships;  (B)  increasing  accountability; 
(C)  providing  strategic,  long  term  planning;  (D)  using  the 
knowledge  base  for  effective  schooling  practices;  (E) 
enhancing  the  education  profession  by  attracting,  training, 
and  retaining  teachers  and  administrators;  (F)  emerging 
concern  about  the  Hrising  underclass"  of  at-risk  youth. 

The  Northwest  Regional  Laboratory  and  the  other 
regional  laboratories  can  and  must  focus  their  efforts  on 
regional  issues  that  evolve  from  local  and  state  issues. 
Their  role  must  be  to  identify  and  understand  the  "big 
picture"  on  at  least  the  regional  basis. 

In  addition,  the  labs  can  coordinate  their  own 
efforts,  as  well  as  those  of  local,  state,  and  federal 
agencies  and  organizations. 

Besides  networking,  the  Lab  should  continue  the 
development  of  effective  and  accurate  assessment  tools; 
secondly,  conduct  meaningful  research  on  effective  practices 
involving  rural,  small  schools;  third,  research  the 
effectiveness  of  distance  educational  programs  involving  the 
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use  of  telecommunications  and  advanced  technology;  fourth, 

■v 

continue  product;  development,  publication  and  distribution 
of  materials  concerning  contemporary  research,  teaching 
strategies,  effective  educational  practices,  model  curricular 
programs,  and  recognition  awards;  fifth,  provide  additional 
technical  assistance,  so  as  to  improve  instruction;  and 
sixth,  broaden  the  participation  by  educators  in  inservice, 
workshops,  conferences,  and  the  like. 

Direct  involvement  with  classroom  teachers  may  be  more 
effective  as  an  impact  mode,  rather  than  working  indirectly 
through  cadre  teams  and  administrators. 

The  Northwest  Regional  Educational  Laboratory  must 
play  an  active  role  in  the  educational  process  of  developing 
our  youth. 

All  labs  must  work  in  conjunction  with  local,  state, 
regional,  and  federal  organizations.  The  regional  lab  is  a 
vital  intermediary  in  determining  national  policies. 

Simultaneously  the  labs  must  listen  to  the  concerns 
of  local  and  state  agencies,  then  communicate  those  concerns 
to  the  federal  government. 

As  a  facilitator,  the  lab  interprets  and  implements 
local  concerns  and  national  policies. 

As  a  synthesizer  of  information  and  a  source  of 
knowledge,  ideas,  and  technical  assistance  the  lab  reflects 
its  constituencies. 
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Education  and  society  have  their  problems,  but  the 
Northwest  Regional  Educational  Laboratory  is  not  one  of  those 
problems . 

One  would  be  hard  pressed  to  find  any  organization 
more  efficiently  organized  or  more  effectively  utilizing  each 
dollar  available. 

In  fact,  additional  funding  allowing  continued 
expansion  of  Northwest  Regional  Educational  Laboratory 
programs  and  other  labs  would  make  a  substantial  impact 
immediately  upon  solving  such  serious  issues  as  substance 
abuse,  At-Risk  youth,  rural  education,  outcome  based 
education,  research,  professional  development,  and  improving 
the  declining  performance  levels  of  our  students  and 
educators  alike. 

The  Lab  has  and  will  continue  to  make  an  outstanding 
contribution  to  education.    Thank  you. 

MR.  EGERMEIER:     Eugene  Paslov. 

MR.  PASLOV:    I  assume  this  is  the  proper  order. 

MR.  EGERMEIER:     Right.    Thank  you. 


PRESENTATION 

BY  MR.  EUGENE  PASLOV: 

Thank  you  and  good  morning.    I'm  not  quite  as  gracious 
and  poetic  as  our  colleague  from  Hawaii  but  good  morning, 
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none  the  less. 

My  name  is  Eugene  Paslov.  That's  P-A-S-L-O-V.  I'm 
the  state  superintendent  of  Public  Instruction  for  Nevada  and 
I'm  also  the  chairman  rf  the  board  of  directors  of  the  Far 
West  Laboratory  for  Educational  Research  and  Development 
located  here  in  San  Francisco. 

My  statement  today  is  co-authored  by  Paul  Houston, 
superintendent  of  the  Tucson  Unified  School  District  in 
Arizona  and  chairman  of  the  board  of  the  Southwest  Regional 
Laboratory  which  is  in  Los  Alamitos,  California. 

As  you  know,  these  two  regional  laboratories  date  back 
to  1966  when  public  education  agencies  exercised  Joint  Power 
agreements  under  California  law  to  form  them. 

Their  mission  is  to  serve  educational  needs  in  the 
Western  region's  four  states,  Arizona,  California,  Utah  and 
Nevada . 

In  1985  regional  laboratory  competition,  the  two 
laboratories  were  forced  to  vie  with  each  other  for  OERI 
funding. 

Far  West  Lab  won  the  competition  but  SWRL,  SWRL's 
board  and  the  staff  have  been  able  to  continually  secure 
other  funding  to  maintain  a  program  of  work  with  schools  and 
educational  agencies  throughout  the  region. 

Far  West  and  Southwest  Laboratories  have  chosen  to 
cooperate  rather  than  compete  in  meeting  regional  needs. 
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Proudly,  we  work  together  on  a  number  of  school 
improvement  ventures.  Because  we  have  a  shared  understanding 
of  the  Western  region's  educational  needs  and  opportunities! 
we've  decided  to  make  a  joint  statement  today  in  which  we 
will  explain  those  challenges  and  tall  you  why  we  think 
laboratories  plan  an  indispensable  role  in  helping  the 
educational  community  respond  to  them. 

In  announcing  this  meeting,  you  raised  four  issues 
that  you  wanted  addressed. 

(1)  What  laboratory  activities  have  been  most 
valuable  in  the  past  two  or  three  years? 

(2)  How  can  laboratories  contribute  to  improving 
education? 

(3)  What  kinds  of  lab  activities  and  strategies  would 
be  most  beneficial  in  the  future?  And 

(4)  What  should  be  the  relationship  between  labs  and 
others  seeking  improvements  in  the  schools? 

Before  I  begin  answering  these  questions,  let  me  first 
outline  some  key  characteristics  and  needs  of  the  Western 
region. 

In  that  context,  I'll  be  better  able  to  describe  the 
laboratories '  roles . 

The  Western  region's  four  states,  Arizona,  California, 
Nevada,  and  Utah  provide  K-12  education  for  more  than  six 
million  students  and  over  9,000  public  schools  and  5,000 
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private  schools. 

This  is  a  place  of  enormous  contrasts.    For  instance, 
California    has    approximately    80    percent    of    the  region's 
students  while  just  three  percent  live  in  my  own  state, 
Nevada . 

In  these  four  states  you'll  find  remarkable  diversity. 
Some  of  the  nation's  largest  urban  centers  are  here  and  some 
of  its  smallest  rural  communities. 

There  is  an  astonishing  ethnic,  linguistic  and 
cultural  mix.  And  state  to  state,  this  mix  shows  up 
differently. 

In  California,  the  schools'  minority  population  has 
swelled  to  more  than  50  percent.  In  Utah,  by  contrast,  only 
seven  percent  of  the  students  are  minorities. 

Each  state  also  differs  in  such  things  as  the  way  its 
schools  are  organized,  state  versus  local  funding  and 
control ,  and  school-improvement  philosophy  and  policy 
ventures • 

These  differences  mean  that  the  program  design  of 
rsgional  laboratories  must  be  elastic. 

And  here  I  want  to  commend  the  Department:  of  Education 
and,  05RI  for  allowing  the  Boards  of  the  laboratories 
substantial  flexibility  to  set  priorities  and  allocate  funds 
according  to  each  region's  own  needs  and  opportunities. 

We   t  trongly   urge  you  to  maintain  this   policy  of 
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flexibility. 

We  educators  in  the  Western  region  share  some  very 
clear  priorities.  We  are  dealing  with  rapidly  expanding 
enrollments. 

California's  overall  population  is  growing  at  a  rate 
more  than  double  the  national  average  and  Nevada  and  Arizona 
are  growing  even  faster. 

We  are  also  looking  at  rapidly  growing  proportion  of 
ethnic  and  racial  minorities,  chiefly  because  of  immigration 
into  Arizona  and  California.  This  is  dramatically  raising 
the  numbers  of  students  with  limited  English  proficiency. 

Like  educators  around  the  nation,  we  are  faced  with 
meeting  rising  expectations  for  improved  educational 
performance • 

Schools  are  now  expected  to  be  more  accountable  and 
efficient.  At  the  same  time  they  must  expand  what  they  do. 
Good  schools  —  good  schools  now  teach  computer  literacy  and 
improved  thinking  skills.  They  also  offer  programs  designed 
to  prevent  drug  abuse  and  teen  pregnancy. 

We  have  an  urgent  need  for  more  and  better-trained 
school  personnel.  California  alone  will  require  85,000  new 
teachers  in  the  next  six  year 3. 

Utah,  Arizona  and  Nevada  are  also  projecting 
shortfalls.  Thus  a  key,  long-term  issue  is  the  recruitment 
and  retention  of  top-quality  younger  educators. 
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Our  need  for  expanded  school  financing  is  chronic. 
Local  funding  has  generally  not  been  able  to  offset  the 
effects  of  cutbacks  in  state  and  federal  funding.  Many  of 
our  districts  have  been  forced  to  cut  staff,  programs,  and 
services  even  as  enrollments  and  special  needs  markedly 
increase . 

And  so  as  the  region's  complexity  increases,  the  need 
for  long-term,  multi-organizational  planning  and  cooperation 
becomes  acute. 

Now  let's  talk  about  the  vital  role  that  the 
laboratories  play  in  serving  educators .  And  here  I  can  begin 
to  answer  the  questions  you  raised  originally. 

One,  you  asked  what  laboratory  activities  have  been 
most  valuable  in  the  last  two  or  three  years.  I  would  say 
three  things. 

First,  laboratories  have  given  teachers , 
administrators,  and  policymakers  information  they  critically 
need  to  do  their  job. 

Labs  are  uniquely  able  to  distill  and  synthesize 
current  research,  stay  on  top  of  the  best  thinking,  and  make 
those  insights  available  to  classroom  educators  and  to 
policymakers. 

Newsletters ,  brochures ,  policy  briefs ,  research 
summaries,  directories,  all  of  these  are  used  by  labs  to 
disseminate  practical  information. 
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Second,  laboratories  act  as  a  catalysts,  brokers  and 
coordinators.  Laboratories  bring  people  together  at 
meetings,  forums,  conferences,  roundtables  to  help  them  get 
a  better  fix  on  their  common  problems.  This  brokering  role 
is  a  crucial  means  of  helping  educators  get  the  most  out  of 
scarce  resources  and  funds. 

Third,  laboratories  provide  direct  services.  Labs 
give  educators  hands-on  help  that  enables  them  to  convert 
information  into  change. 

Let  me  provide  some  examples  from  the  Far  West  Lab. 
In  Nevada,  Far  West  helped  us  assist  our  rural  schools  in 
meeting  newly  adopted  graduation  requirements  in  Arts  and 
Humanities • 

We  were  able  to  create  a  consortium  made  up  of  the 
humanities  committee,  our  State  Department  of  Education,  the 
University  of  Nevada  at  Reno,  several  school  districts  and 
the  lab.  This  consortium  prepared  teachers  all  over  the 
state  to  teach  an  interdisciplinary  course  that  fulfilled 
this  new  requirement. 

In  Utah,  Far  West  Lab  has  an  on-going  partnership  with 
the  directors  of  the  state's  four  regional  service  centers  and 
the  Utah  State  Office  of  Education  to  help  the  centers  take 
a  more  active  role  in  initiating  and  sustaining  school 
reforms. 

In    California,    Far    West    works    with    the  State 
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Department  of  Education's  County-State  Steering  Committee  to 
help  staff  in  the  58  county  offices  find  ways  of  implementing 
one  of  the  state's  latest  priorities:  middle  school  reform. 

In  Arizona,  under  a  memorandum  of  understanding  with 
state  school  superintendent  Diane  Bishop,  Far  West  helped  the 
Department  of  Education  launch  a  four-year  pilot  program 
aimed  at  helping  kids  in  grades  R-3  who  are  at  risk. 

All  of  these  efforts  dhow  how  the  laboratory  performs 
its  essential  function  as  catalyst.  Again,  bringing  people 
together  is  ona  of  the  critical  ways  to  stretch  resources, 
time,  people  and  money. 

Far  West  Laboratory's  direct  service  work  involves, 
for  starters,  supporting  a  range  of  State  Department  of 
Education  initiatives.  There  are  many  fine  examples,  but 
I've  limited  time  so  I'll  give  you  one  from  my  own  state. 

The  laboratory  conducted  a  f ol low-up  s t udy  of  10 
schools  that  participated  in  a  first  year  of  the  Nevada 
School  Improvement  Project  •  That  report  gave  us  tfie 
documentation  we  needed  to  convince  our  legislature  and  local 
school  districts  to  expand  its  School  Improvement  Grant  Fund. 

It  also  helped  my  department's  staff  identify 
strategies  for  sustaining  each  school's  improvement 
activities  beyond  the  start-up  year. 

I  might  add  that  we  have  from  that  10-school  start-up 
now  we  have  over  60  schools  involved  in  that  particular 
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project  and  a  good  deal  of  that  expansion  has  been  the  work 
of  the  Far  West  Lab* 

The  labs  local  collaborations  are  equally  important 
and  sometimes  lead  to  unexpected  kinds  of  successes* 

Again,  to  choose  one  example,  when  the  lab  recently 
helped  the  Los  Angeles  Unified  School  District  develop 
training  materials  for  its  900  mentor  teachers,  the  work 
evolved  into  two  nationally-circulated,  pioneering  casebook 
publications  written  by  and  for  teachers. 

In  The  Mentor  Teacher  Casebook,  published  in  1987  by 
the  Far  West  and  ERIC  Clearinghouse  on  Educational 
Management,  mentor  teachers  shared  powerful  first-person 
accounts  of  successes  and  failures. 

In  The  Intern  Teacher  Casebook,  published  in  1988, 
novice  teachers  detailed  the  fears  and  frustrations  they 
faced  during  their  first  shaky  moments  in  the  classroom* 

These  books  are  groundbreaking  additions  to  the 
growing  body  of  case  literature  that  is  transforming  the 
nation's  teacher  preservice  and  inservice  training. 

In  all  of  its  assistance,  the  laboratory  aims  to 
design  strategies  that  will  enable  educators  to  sustain 
improvements  on  their  own. 

A  good  example  of  this  is  the  Peer  Assisted  Leadership 
Program,  or  PAL,  which  works  with  school  principals,  171  of 
them  in  1988  alone. 
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PAL  teaches  techniques  such  as  -shadowing"  another 
principal  for  a  day.  That  helped  principals  reflect  on  what 
they  do  and  share  ideas  with  each  other. 

PAL's  strategy  is  to  train  teachers  who  then  go  on  to 
conduct  future  inservice  workshops. 

In  this  way,  the  program  reaches  a  wide  audience  and 
builds  support  capabilities  within  the  region. 

Let's  move  on  with  your  questions.  As  I  read  them, 
it  seems  to  me  that  numbers  2  and  3  are  highly  related,  so 
I'll  respond  to  them  together. 

No.  2,  how  can  laboratories  contribute  to  improving 
education  and,  No.  3,  what  kinds  of  lab  activities  and 
strategies  would  be  most  beneficial  in  the  future? 

Well,  certainly  the  four  types  of  contributions  that 
I've  just  cited  are  excellent  example  of  those  to  these 
questions « 

To  reiterate  ,  laboratories  can  engage  in  long-term, 
statewide  collaborations  in  which  they  work  with  state 
departments  of  education  and  other  key  educational  agencies 
in  each  state  on  high  priority  improvement  initiatives. 

Laboratories  can  continue  to  offer  focused,  state- 
level  support  that  enhances  the  capability  of  state 
departments  of  education  to  lead  and  to  help  sustain  school 
improvements • 

Laboratories  can  expand  their  local,  high- leverage, 


ERJC 


California  Shorthand  Reporting 

HEARINGS  -  DZPOSmONS  •  ARBITRATIONS 
52  lAm«ootf  Drht,  Sm  WW.  CA  94901 
m  (419  4574417 


Copyright© 


1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 


27 

developmental  collaborations  with  large  urban  school 
districts . 

And  laboratories  can  continue  to  help  improve  the 
capacity  for  professional  development  of  educators. 

And  let  me  now  briefly  touch  on  other  promising 
strategies . 

Laboratories  could  do  even  more  than  they  do  now  to 
bring  educators  together  to  develop  a  future-oriented  vision 
of  educational  excellence,  and  then  to  find  practical,  usable 
ways  of  reaching  that  vision. 

The  laboratories  must  maintain  and  strengthen  their 
capacity  to  do  region- specific  R&D  and  policy  studies. 

I  can  personally  attest  to  the  great  need  for  this 
work  and  also  to  severe  limitations  in  state  resources  and 
funding  to  do  it. 

This  gap  can  be  filled  by  the  labs.  During  the  past 
several  years,  Far  West  Laboratory,  Southwest  Regional 
Laboratory  have  documented  or  evaluated  a  number  of  highly 
promising  programs  and  practices  and  done  several  outstanding 
policy  evaluation  studies  and  needs  assessments,  some  of 
these  in  Nevada. 

The  labs  have  also  developed  valuable  models  and 
resource  materials.  I've  already  mentioned  Far  West  Lab's 
Peer  Assisted  Leadership  and  teacher  casebooks. 

Now,    to   your    last    question,    what    should   be  the 
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relationship  between  the  labs  and  others  seeking  improvement 
in  the  schools,  in  a  word,  collaborative. 

Sometimes  this  collaboration  is  highly  visible.  At 
other  times  laboratories  function  more  like  Hgo-fersM  or 
stage-hand,  nearly  anonymous. 

But  in  each  case,  Far  West  Laboratory  has  been  active, 
opportunistic,  and  persistent  in  developing  long-  and  short- 
term  relationships,  more  than  100  agencies  in  1988  alone. 

These  include  all  four  state  departments  of  education,  a 
state  legislature,  two  state  boards  of  education,  38  county 
offices   of   education   in  California,    all    four   of  Utah's 
regional   service  centers   and  a  range  of  other  agencies, 
associations,  and  districts  of  all  sizes. 

With  the  help  of  OERI  and  other  federal,  state  and 
local  foundation  funders,  the  laboratory  has  contributed 
personnel  and  other  resources  to  these  collaborations. 

In  some  cases,  costs  have  been  shared.  In  others,  the 
cooperating  agency  has  funded  most  of  the  work. 

In  this  regard,  I  will  note  that  state  and  local 
agencies  must  follow  competitive  procurement  requirements. 

In  other  words,  the  laboratory  often  bids  against 
other  competitors  for  agency  funds.  Here  the  guidance  and 
oversight  of  the  independent  board  of  directors  which  broadly 
represents  major  stakeholders  in  the  region  is  particularly 
useful. 
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The  board  helps  the  laboratory  find  the  rignt  balance 
between  entrepreneurial  enterprise  and  wise  stewardship  of 
the  region's  best  educational  interests. 

I  think  that  emphas  i  z  ing  the  impor  t  anc  e  of  an 
independent  governing  board  is  an  appropriate  way  for  me  to 
close. 

I've  already  spoken  of  the  value  of  flexibility.  An 
independent ,  regionally  representative  board  keeps  the 
flexibility  honest  by  helping  the  laboratory  set  priorities 
and  make  choices  in  an  equitable,  far-sighted  way. 

Labs  also  need  credibility,  and  that  too  is  ensured 
when  decisionmakers  and  collaborators  know  that  the  Board 
isn't  just  advisory,  but  has  the  legal  clout  to  make  wise 
regional  decisions  and  act  on  them. 

In  short,  our  Joint  Power  signatories  and  our  board 
members  themselves  believe  it  is  vital  to  keep  the 
requirement  of  an  independent  governance  structure  for 
laboratories . 

We  appreciate  OERI's  interest  in  collecting  opinions 
from  across  the  county  in  preparation  for  the  recompetition 
of  the  regional  education  laboratories. 

Thank  you  for  the  opportunity  to  make  this  statement. 

MR.  EGERMEIER:  Thank  you  very  much  for  staying.  Are 
there  any  others  present  who  would  like  to  make  a  statement 
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before  this  group  for  the  record? 

If  there  are  no  others,  we  will  take  a  recess  until 
we  hear  from  others  who  wish  to  make  a  statement. 

(Whereupon,  the  proceeding  concluded  at  this  time.) 
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